[ 512.603513] env[61555]: INFO neutron.common.config [-] Logging enabled! [ 512.603513] env[61555]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev57 [ 512.603513] env[61555]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=61555) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} [ 512.603797] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 512.603797] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 512.604696] env[61555]: WARNING oslo_policy.policy [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 512.605097] env[61555]: WARNING oslo_policy.policy [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 512.606457] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 512.623364] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Session token - acquiring [ 512.624278] env[61555]: DEBUG networking_nsxv3.common.locking [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61555) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 512.624500] env[61555]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 512.624628] env[61555]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 512.625109] env[61555]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 512.636585] env[61555]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 512.944596] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 512.956519] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Activating Management API Provider. [ 512.995736] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Looking for the default Switching Profiles. [ 512.995989] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 513.019683] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Activating Policy API Provider. [ 513.019935] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Looking for the default Infrastructure Rules. [ 513.104225] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Looking for the Default Layer3 Logged Drop Section. [ 513.125802] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 513.126423] env[61555]: DEBUG networking_nsxv3.common.locking [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61555) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.126423] env[61555]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Acquiring lock "migration-tracking" {{(pid=61555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 513.126649] env[61555]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Acquired lock "migration-tracking" {{(pid=61555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 513.126886] env[61555]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Acquired external semaphore "migration-tracking" {{(pid=61555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 513.126989] env[61555]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Releasing lock "migration-tracking" {{(pid=61555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 513.127218] env[61555]: DEBUG networking_nsxv3.common.locking [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61555) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.127379] env[61555]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Acquiring lock "all" {{(pid=61555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 513.127513] env[61555]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Acquired lock "all" {{(pid=61555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 513.127747] env[61555]: DEBUG oslo_concurrency.lockutils [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Acquired external semaphore "all" {{(pid=61555) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 513.128028] env[61555]: DEBUG networking_nsxv3.api.rpc [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61555) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 513.159954] env[61555]: DEBUG networking_nsxv3.api.rpc [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61555) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 513.172664] env[61555]: DEBUG networking_nsxv3.api.rpc [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61555) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 513.183313] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] Inventory metadata is going to be refreshed. [ 513.183471] env[61555]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ac3cfa70-402d-4726-89c9-39ea9d922c46 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 515.373970] env[61817]: INFO neutron.common.config [-] Logging enabled! [ 515.374319] env[61817]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev57 [ 515.374512] env[61817]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=61817) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} [ 515.374754] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 515.374853] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 515.375793] env[61817]: WARNING oslo_policy.policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 515.376027] env[61817]: WARNING oslo_policy.policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 515.377324] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 515.393924] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Session token - acquiring [ 515.394751] env[61817]: DEBUG networking_nsxv3.common.locking [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 145 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 443 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 207 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_mgmt.py, line 454 in _load_zones>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 276 in get_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 107 in decorator>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py, line 202 in _login>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 515.394961] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 515.395090] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 515.395459] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 515.405997] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 515.704276] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 515.714582] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Activating Management API Provider. [ 515.725708] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_mgmt [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Looking for the default Switching Profiles. [ 515.725957] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 515.745474] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Activating Policy API Provider. [ 515.745729] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Looking for the default Infrastructure Rules. [ 515.825849] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Looking for the Default Layer3 Logged Drop Section. [ 515.845316] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 515.845812] env[61817]: DEBUG networking_nsxv3.common.locking [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 515.846011] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 515.846139] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 515.846407] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 515.846555] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 515.846786] env[61817]: DEBUG networking_nsxv3.common.locking [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 515.846942] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquiring lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 515.847062] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 515.847275] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired external semaphore "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 515.847566] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 515.869331] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 515.876294] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 515.882954] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Inventory metadata is going to be refreshed. [ 515.883155] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 516.653671] env[61817]: DEBUG networking_nsxv3.common.locking [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 516.653671] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 516.653671] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 516.654382] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 516.660555] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 516.661323] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 516.662288] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 516.687785] env[61817]: DEBUG networking_nsxv3.common.locking [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 516.688333] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 516.688608] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 516.689005] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 516.692451] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 516.693058] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 516.693322] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 516.693564] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 516.718186] env[61817]: DEBUG networking_nsxv3.common.locking [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 516.718962] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 516.719283] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 516.719902] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 516.720280] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 516.720645] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 516.747353] env[61817]: DEBUG networking_nsxv3.common.locking [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 516.747949] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 516.748223] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 516.748689] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 516.749032] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 516.749312] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 516.779435] env[61817]: DEBUG networking_nsxv3.common.locking [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 516.779953] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 516.780209] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 516.780690] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 516.780987] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 516.781292] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 516.781548] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 516.781836] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 516.803463] env[61817]: DEBUG networking_nsxv3.common.locking [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 516.803963] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquiring lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 516.804247] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 516.804635] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired external semaphore "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 516.804904] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Releasing lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 516.805191] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 516.805429] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 516.805663] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 516.830194] env[61817]: DEBUG networking_nsxv3.common.locking [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/bin/neutron-nsxv3-agent, line 10 in <module>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 331 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 151 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 53 in __init__>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 505 in _dryrun>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 516.830751] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 516.831012] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 516.831455] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 516.831777] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 516.832107] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 516.832351] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 516.832581] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Inventory metadata have been refreshed. [ 516.832807] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Dryrun:True. Metadata refresh completed. [ 516.833287] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Releasing lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 516.834425] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] VMware NSXv3 Agent initialized successfully. [ 516.834940] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquiring lock "singleton_lock" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 516.835197] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Acquired lock "singleton_lock" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 516.835527] env[61817]: DEBUG oslo_concurrency.lockutils [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Releasing lock "singleton_lock" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 516.835939] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Full set of CONF: {{(pid=61817) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:363}} [ 516.836201] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ******************************************************************************** {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} [ 516.836412] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] Configuration options gathered from: {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} [ 516.836643] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} [ 516.836923] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} [ 516.837135] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ================================================================================ {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} [ 516.837410] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] agent_down_time = 75 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.837663] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] allow_automatic_dhcp_failover = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.837927] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] allow_bulk = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.838186] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] api_extensions_path = {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.838452] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] api_paste_config = api-paste.ini {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.838731] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] auth_strategy = keystone {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.838949] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] backdoor_port = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.839168] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] backdoor_socket = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.839420] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] backlog = 4096 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.839679] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] base_mac = fa:16:3e:00:00:00 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.839950] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] bind_host = 0.0.0.0 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.840231] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] bind_port = 9696 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.840532] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] client_socket_timeout = 900 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.840804] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] config_dir = [] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.841025] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.841281] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] config_source = [] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.841562] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] control_exchange = neutron {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.841856] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] core_plugin = ml2 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.842129] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] debug = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.842392] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] default_availability_zones = [] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.842722] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.843041] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] dhcp_agent_notification = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.843295] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] dhcp_agents_per_network = 1 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.843539] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] dhcp_lease_duration = 86400 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.843802] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] dhcp_load_type = networks {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.844068] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] dns_domain = openstacklocal {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.844340] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.844591] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] enable_default_route_bfd = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.844837] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] enable_default_route_ecmp = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.845080] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] enable_dvr = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.845323] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] enable_new_agents = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.845599] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.845871] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] enable_signals = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.846124] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] enable_traditional_dhcp = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.846368] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] external_dns_driver = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.846615] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] filter_validation = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.846885] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] global_physnet_mtu = 8950 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.847138] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] graceful_shutdown_timeout = 60 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.847443] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] host = cpu-1 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.847703] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] host_dvr_for_dhcp = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.847951] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] http_retries = 3 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.848220] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] instance_format = [instance: %(uuid)s] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.848515] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.848789] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ipam_driver = internal {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.849043] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ipv6_pd_enabled = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.849291] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] l3_ha = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.849545] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.849814] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] l3_ha_network_physical_name = {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.850071] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] l3_ha_network_type = {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.850323] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] log_config_append = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.850606] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.850871] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] log_dir = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.851132] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] log_file = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.851349] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] log_options = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.851613] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] log_rotate_interval = 1 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.851874] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] log_rotate_interval_type = days {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.852162] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] log_rotation_type = none {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.852396] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.852610] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.852904] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.853186] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.853406] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.853723] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] max_dns_nameservers = 5 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.853981] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] max_header_line = 16384 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.854230] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] max_l3_agents_per_router = 3 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.854474] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] max_logfile_count = 30 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.854720] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] max_logfile_size_mb = 200 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.854977] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] max_subnet_host_routes = 20 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.855235] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] my_ip = 10.180.1.21 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.855492] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] my_ipv6 = ::1 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.855744] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] network_auto_schedule = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.855990] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] network_link_prefix = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.856283] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.856563] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] notify_nova_on_port_data_changes = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.856816] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] notify_nova_on_port_status_changes = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.857074] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] pagination_max_limit = -1 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.857324] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] publish_errors = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.857572] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] rate_limit_burst = 0 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.857841] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] rate_limit_except_level = CRITICAL {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.858102] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] rate_limit_interval = 0 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.858363] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] retry_until_window = 30 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.858624] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] router_distributed = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.858890] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] rpc_resources_processing_step = 20 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.859146] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] rpc_response_max_timeout = 600 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.859393] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] rpc_response_timeout = 60 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.859640] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] send_events_interval = 2 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.859918] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] service_plugins = ['router'] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.860204] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] setproctitle = on {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.860474] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] state_path = /opt/stack/data/neutron {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.860770] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] syslog_log_facility = LOG_USER {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.861050] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] tcp_keepidle = 600 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.861329] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] transport_url = **** {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.861619] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] use_eventlog = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.861879] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] use_journal = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.862161] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] use_json = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.862415] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] use_ssl = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.862655] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] use_stderr = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.862922] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] use_syslog = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.863172] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] vlan_transparent = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.863428] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] watch_log_file = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.863690] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] wsgi_default_pool_size = 100 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.863938] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] wsgi_keep_alive = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.864214] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.864466] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] wsgi_server_debug = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} [ 516.864758] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_concurrency.disable_process_locking = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.865027] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.865299] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.865551] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.865849] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.866144] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.866416] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.866690] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler.connection_string = messaging:// {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.866947] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler.enabled = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.867205] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler.es_doc_type = notification {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.867455] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler.es_scroll_size = 10000 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.867724] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler.es_scroll_time = 2m {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.867976] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler.filter_error_trace = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.868247] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler.hmac_keys = **** {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.868503] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler.sentinel_service_name = mymaster {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.868764] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler.socket_timeout = 0.1 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.869030] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler.trace_requests = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.869284] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler.trace_sqlalchemy = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.869546] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler_jaeger.process_tags = {} {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.869814] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler_jaeger.service_name_prefix = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.870074] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] profiler_otlp.service_name_prefix = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.870350] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_policy.enforce_new_defaults = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.870640] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_policy.enforce_scope = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.870918] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_policy.policy_default_rule = default {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.871195] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.871483] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.871785] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.872105] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.872364] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.872612] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.872865] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.873130] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.873417] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] agent.extensions = [] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.873688] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.873946] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] service_providers.service_provider = [] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.874205] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] QUOTAS.default_quota = -1 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.874477] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.874923] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] QUOTAS.quota_floatingip = 50 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.875226] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] QUOTAS.quota_network = 100 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.875568] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] QUOTAS.quota_port = 500 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.875910] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.876184] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] QUOTAS.quota_router = 10 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.876437] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] QUOTAS.quota_security_group = 10 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.876690] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.876937] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] QUOTAS.quota_subnet = 100 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.877184] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] QUOTAS.track_quota_usage = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.877465] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.877719] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep.group = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.878006] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep.helper_command = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.878277] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.878532] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep.thread_pool_size = 8 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.878795] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep.user = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.879053] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.879302] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_dhcp_release.group = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.879547] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_dhcp_release.helper_command = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.879803] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.880066] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.880334] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_dhcp_release.user = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.880621] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.880909] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_ovs_vsctl.group = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.881175] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_ovs_vsctl.helper_command = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.881450] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.881736] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.881990] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_ovs_vsctl.user = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.882244] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_namespace.capabilities = [21] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.882490] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_namespace.group = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.882740] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_namespace.helper_command = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.883003] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.883253] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_namespace.thread_pool_size = 8 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.883497] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_namespace.user = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.883751] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_conntrack.capabilities = [12] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.884029] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_conntrack.group = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.884302] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_conntrack.helper_command = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.884572] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.884828] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.885089] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_conntrack.user = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.885345] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_link.capabilities = [12, 21] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.885592] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_link.group = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.885851] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_link.helper_command = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.886103] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.886365] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_link.thread_pool_size = 8 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.886610] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] privsep_link.user = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.886881] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.887175] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.887436] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.continue_on_failed_promotions = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.887680] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.dscp = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.887934] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.dscp_inherit = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.888207] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.force_mp_to_policy = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.888471] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.locking_coordinator_url = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.888726] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.log_agent_heartbeats = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.888979] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.logging_expire = 1 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.889236] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.889483] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.889755] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.polling_interval = 240 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.890038] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.890310] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.890595] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.report_interval = 30.0 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.890878] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.891144] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.891416] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.891698] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.sync_skew = 60 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.891953] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.synchronization_queue_size = 20 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.892294] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT.use_helper_for_ns_read = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.892557] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] SECURITYGROUP.enable_ipset = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.892876] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] SECURITYGROUP.enable_security_group = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.893185] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.893457] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.893729] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] experimental.ipv6_pd_enabled = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.893990] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] experimental.linuxbridge = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.894277] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ml2.extension_drivers = ['port_security'] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.894532] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ml2.external_network_type = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.894808] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.895081] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ml2.overlay_ip_version = 4 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.895412] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ml2.path_mtu = 8950 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.895689] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ml2.physical_network_mtus = [] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.895975] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ml2.tenant_network_types = ['vlan'] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.896259] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.896548] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ml2.type_drivers = ['vlan'] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.896814] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT_CLI.neutron_port_id = [] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.897066] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.897324] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.897586] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.mp_to_policy_retry_count = 10 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.897887] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.mp_to_policy_retry_sleep = 2 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.898154] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.898426] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.898693] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.898962] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.899224] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.899499] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.899816] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.900092] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_login_password = **** {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.900359] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_login_port = 443 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.900644] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_login_user = admin {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.901044] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.901325] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.901622] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.901895] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.902161] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.902436] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.902705] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.902966] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.903230] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.903491] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.903799] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.904086] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.904415] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.904695] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] vsphere.vsphere_login_password = VMware1! {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.904956] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.905225] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.905495] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] nova.auth_section = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.905772] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] nova.auth_type = password {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.906033] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.906282] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] nova.certfile = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.906551] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] nova.collect_timing = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.906819] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] nova.endpoint_type = public {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.907071] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] nova.insecure = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.907315] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] nova.keyfile = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.907573] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] nova.region_name = RegionOne {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.907839] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] nova.split_loggers = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.908100] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] nova.timeout = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.908368] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] placement.auth_section = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.908647] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] placement.auth_type = password {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.908914] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.909177] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] placement.certfile = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.909441] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] placement.collect_timing = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.909715] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] placement.endpoint_type = public {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.909966] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] placement.insecure = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.910212] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] placement.keyfile = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.910462] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] placement.region_name = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.911257] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] placement.split_loggers = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.911570] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] placement.timeout = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.911858] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.auth_section = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.912181] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.auth_type = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.912439] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.cafile = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.912698] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.certfile = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.912964] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.collect_timing = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.913213] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.connect_retries = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.913461] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.connect_retry_delay = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.913719] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.enable_notifications = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.913976] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.endpoint_override = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.914226] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.insecure = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.914469] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.interface = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.914714] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.keyfile = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.915023] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.max_version = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.915284] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.min_version = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.915534] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.region_name = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.915782] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.retriable_status_codes = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.916166] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.service_name = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.916504] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.service_type = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.916772] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.split_loggers = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.917097] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.status_code_retries = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.917367] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.status_code_retry_delay = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.917630] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.timeout = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.917882] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.valid_interfaces = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.918132] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ironic.version = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.918422] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] cli_script.dry_run = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.918710] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.918966] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.919231] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.919486] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.919740] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.919990] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.920245] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.920541] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.920809] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.921063] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.921329] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.921625] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.921921] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.922186] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.922440] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.922703] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.922957] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.923216] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.923469] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.923720] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.923971] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.924247] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.924495] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.924759] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.925013] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.925284] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.ssl = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.925550] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.925813] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.926077] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.926342] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.926603] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.926870] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_notifications.driver = [] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.927121] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_notifications.retry = -1 {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.927406] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.927662] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} [ 516.927876] env[61817]: DEBUG oslo_service.service [None req-8dc68d6f-bde4-4feb-b662-6e8266a9efc4 None None] ******************************************************************************** {{(pid=61817) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} [ 516.929087] env[61817]: DEBUG neutron.agent.securitygroups_rpc [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] Init firewall settings (driver=nsxv3) {{(pid=61817) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:124}} [ 516.930571] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=61817) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 516.930984] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] RPC agent_id: nsxm-l-01a.corp.local [ 516.932768] env[61817]: INFO neutron.agent.agent_extensions_manager [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] Loaded agent extensions: [] [ 516.933446] env[61817]: DEBUG neutron_lib.callbacks.manager [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=61817) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 516.998037] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent RPC Daemon Started! [ 516.998405] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:0 started [ 516.998613] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent out of sync with plugin! [ 520.846193] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 520.846571] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 521.836415] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 521.836575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 521.836651] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 521.836981] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 521.837075] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 521.837259] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 521.837369] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 521.837433] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 521.837579] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 521.837774] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 521.845598] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 521.854231] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 521.867130] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 521.867230] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 522.531574] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.531816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 522.531895] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 522.532131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 522.544425] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 522.544872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 522.545597] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 522.571726] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.571873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 522.571911] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 522.572132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 522.575559] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 522.575931] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 522.576027] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 522.576108] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 522.596108] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.596275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 522.596335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 522.596528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 522.596687] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 522.596801] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 522.627251] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.627449] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 522.627449] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 522.627603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 522.627769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 522.627884] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 522.657271] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.657499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 522.657499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 522.657706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 522.657820] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 522.657940] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 522.658016] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 522.658088] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 522.678371] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.678633] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 522.678633] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 522.678877] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 522.678966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 522.679080] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 522.679153] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 522.679222] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 522.726876] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.727107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 522.727107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 522.727298] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 522.727414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 522.727541] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 522.727610] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 522.727680] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 522.727747] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 522.727822] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 522.727885] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 522.727945] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 522.728191] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 522.728256] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 522.728361] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 522.758874] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1030 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.759143] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 522.759143] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 522.759319] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 522.759456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 522.759574] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 522.805531] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1031 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.805843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 522.805843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 522.805944] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 522.806067] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 522.823599] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 522.823787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 525.847366] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 525.847748] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=1], Jobs=0 [ 525.847748] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 528.160260] env[61817]: INFO networking_nsxv3.common.synchronization [None req-e12d1688-02d8-41f1-b668-ae0bde63e68d None None] Enqueued Resource ID: 1ccf1d7d-c47d-4cf0-a2b9-9b9943189a2a with Priority: HIGHEST for action port [ 528.160762] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ccf1d7d-c47d-4cf0-a2b9-9b9943189a2a with Priority: HIGHEST for action port [ 528.161061] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.161180] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 528.161247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 528.161486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 528.161535] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 528.161686] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ccf1d7d-c47d-4cf0-a2b9-9b9943189a2a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.161778] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ccf1d7d-c47d-4cf0-a2b9-9b9943189a2a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 528.161837] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ccf1d7d-c47d-4cf0-a2b9-9b9943189a2a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 528.162024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ccf1d7d-c47d-4cf0-a2b9-9b9943189a2a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 528.162099] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ccf1d7d-c47d-4cf0-a2b9-9b9943189a2a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 528.178467] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ccf1d7d-c47d-4cf0-a2b9-9b9943189a2a [ 528.178672] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.178798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 528.178864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 528.179053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 528.179139] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 528.179228] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ccf1d7d-c47d-4cf0-a2b9-9b9943189a2a already deleted. [ 528.179304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ccf1d7d-c47d-4cf0-a2b9-9b9943189a2a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 533.162086] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 533.162086] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 536.237881] env[61817]: INFO networking_nsxv3.common.synchronization [None req-fd35fa6e-3eb3-49a7-8158-fdd36779861a None None] Enqueued Resource ID: f06e8224-1dac-47d2-b9b4-88d27b0205e4 with Priority: HIGHEST for action port [ 536.238178] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f06e8224-1dac-47d2-b9b4-88d27b0205e4 with Priority: HIGHEST for action port [ 536.238850] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.238850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 536.239001] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 536.239114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 536.239201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 536.239350] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f06e8224-1dac-47d2-b9b4-88d27b0205e4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.239455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f06e8224-1dac-47d2-b9b4-88d27b0205e4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 536.239498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f06e8224-1dac-47d2-b9b4-88d27b0205e4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 536.239694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f06e8224-1dac-47d2-b9b4-88d27b0205e4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 536.239775] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f06e8224-1dac-47d2-b9b4-88d27b0205e4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.288950] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f06e8224-1dac-47d2-b9b4-88d27b0205e4 [ 536.289146] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.289284] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 536.289354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 536.289642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 536.289642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 536.289763] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f06e8224-1dac-47d2-b9b4-88d27b0205e4 already deleted. [ 536.289811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f06e8224-1dac-47d2-b9b4-88d27b0205e4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 541.240020] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 541.240425] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 546.241921] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 546.242285] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 551.243276] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 551.243738] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 556.244476] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 556.244476] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 561.245970] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 561.246322] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.247385] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 566.247762] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.248266] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 571.248660] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 576.248945] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 576.249272] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 578.496875] env[61817]: INFO networking_nsxv3.common.synchronization [None req-4cf7c8c0-2f6b-4bc3-8ee5-6ee4283d5628 None None] Enqueued Resource ID: 94bf9cb9-2704-4bd0-a17d-4a37155193f3 with Priority: HIGHEST for action port [ 578.498330] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94bf9cb9-2704-4bd0-a17d-4a37155193f3 with Priority: HIGHEST for action port [ 578.498753] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.498891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 578.498953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 578.499157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 578.499728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 578.499890] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-94bf9cb9-2704-4bd0-a17d-4a37155193f3 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.502075] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94bf9cb9-2704-4bd0-a17d-4a37155193f3" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 578.502075] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94bf9cb9-2704-4bd0-a17d-4a37155193f3" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 578.511144] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94bf9cb9-2704-4bd0-a17d-4a37155193f3" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 578.511276] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94bf9cb9-2704-4bd0-a17d-4a37155193f3',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.526109] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94bf9cb9-2704-4bd0-a17d-4a37155193f3 [ 578.527065] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.527380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 578.527653] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 578.528009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 578.528214] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 578.528398] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94bf9cb9-2704-4bd0-a17d-4a37155193f3 already deleted. [ 578.528592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94bf9cb9-2704-4bd0-a17d-4a37155193f3" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 579.352347] env[61817]: INFO networking_nsxv3.common.synchronization [None req-570d197d-86b1-4b5e-b7a9-aa6a6b80bfe2 None None] Enqueued Resource ID: 0909761c-2b94-48ad-a209-70468fe273fd with Priority: HIGHEST for action port [ 579.352911] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0909761c-2b94-48ad-a209-70468fe273fd with Priority: HIGHEST for action port [ 579.353230] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.353358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 579.353518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 579.353626] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 579.353709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 579.353862] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-0909761c-2b94-48ad-a209-70468fe273fd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.353958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0909761c-2b94-48ad-a209-70468fe273fd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 579.354020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0909761c-2b94-48ad-a209-70468fe273fd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 579.354209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0909761c-2b94-48ad-a209-70468fe273fd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 579.354288] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0909761c-2b94-48ad-a209-70468fe273fd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.385803] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0909761c-2b94-48ad-a209-70468fe273fd [ 579.385924] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.385987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 579.386047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 579.386250] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 579.386335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 579.386429] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0909761c-2b94-48ad-a209-70468fe273fd already deleted. [ 579.386540] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0909761c-2b94-48ad-a209-70468fe273fd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 581.083156] env[61817]: INFO networking_nsxv3.common.synchronization [None req-683dc8cf-b3dc-4fcc-a6fc-54e937287ae1 None None] Enqueued Resource ID: d8245799-54e4-4626-83de-fc1cd0aadc66 with Priority: HIGHEST for action port [ 581.083481] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8245799-54e4-4626-83de-fc1cd0aadc66 with Priority: HIGHEST for action port [ 581.083994] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.084424] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 581.084502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 581.084708] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 581.084798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 581.084966] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8245799-54e4-4626-83de-fc1cd0aadc66 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.085066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8245799-54e4-4626-83de-fc1cd0aadc66" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 581.085142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8245799-54e4-4626-83de-fc1cd0aadc66" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 581.085384] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8245799-54e4-4626-83de-fc1cd0aadc66" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 581.085470] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8245799-54e4-4626-83de-fc1cd0aadc66',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.126171] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8245799-54e4-4626-83de-fc1cd0aadc66 [ 581.126390] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.126524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 581.126593] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 581.126801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 581.126884] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 581.126972] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8245799-54e4-4626-83de-fc1cd0aadc66 already deleted. [ 581.127051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8245799-54e4-4626-83de-fc1cd0aadc66" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 581.963137] env[61817]: INFO networking_nsxv3.common.synchronization [None req-b2149c63-f658-4267-81d0-22ee04a9d6e7 None None] Enqueued Resource ID: 28aa960d-2780-4d63-8da3-b0c11b6d068c with Priority: HIGHEST for action port [ 581.963354] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28aa960d-2780-4d63-8da3-b0c11b6d068c with Priority: HIGHEST for action port [ 581.965206] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.965349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 581.965407] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 581.966423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 581.966423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 581.966423] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-28aa960d-2780-4d63-8da3-b0c11b6d068c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.966423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28aa960d-2780-4d63-8da3-b0c11b6d068c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 581.966423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28aa960d-2780-4d63-8da3-b0c11b6d068c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 581.966423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28aa960d-2780-4d63-8da3-b0c11b6d068c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 581.966699] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28aa960d-2780-4d63-8da3-b0c11b6d068c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.985579] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28aa960d-2780-4d63-8da3-b0c11b6d068c [ 581.985778] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.985908] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 581.986012] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 581.986178] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 581.986262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 581.986350] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28aa960d-2780-4d63-8da3-b0c11b6d068c already deleted. [ 581.986428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28aa960d-2780-4d63-8da3-b0c11b6d068c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 582.287178] env[61817]: INFO networking_nsxv3.common.synchronization [None req-22f4c85c-f059-405a-a09a-c9ed582d78f4 None None] Enqueued Resource ID: b5462697-d5c5-451e-bdac-03b10e08d850 with Priority: HIGHEST for action port [ 582.287481] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5462697-d5c5-451e-bdac-03b10e08d850 with Priority: HIGHEST for action port [ 582.287986] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.288125] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 582.288290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 582.288461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 582.288461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 582.288612] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5462697-d5c5-451e-bdac-03b10e08d850 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.288702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5462697-d5c5-451e-bdac-03b10e08d850" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 582.288761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5462697-d5c5-451e-bdac-03b10e08d850" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 582.288939] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5462697-d5c5-451e-bdac-03b10e08d850" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 582.289016] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5462697-d5c5-451e-bdac-03b10e08d850',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.424849] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5462697-d5c5-451e-bdac-03b10e08d850 [ 582.425067] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.425198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 582.425261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 582.425472] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 582.425551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 582.425651] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5462697-d5c5-451e-bdac-03b10e08d850 already deleted. [ 582.425734] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5462697-d5c5-451e-bdac-03b10e08d850" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 582.540277] env[61817]: INFO networking_nsxv3.common.synchronization [None req-cb0a89df-7bb8-4d42-9294-cef4ec5fd4f0 None None] Enqueued Resource ID: a0d63201-3840-43bf-8b53-63e1b96b6dff with Priority: HIGHEST for action port [ 582.540723] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0d63201-3840-43bf-8b53-63e1b96b6dff with Priority: HIGHEST for action port [ 582.541088] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.541230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 582.541412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 582.541513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 582.541549] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 582.541691] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0d63201-3840-43bf-8b53-63e1b96b6dff taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.541788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0d63201-3840-43bf-8b53-63e1b96b6dff" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 582.541851] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0d63201-3840-43bf-8b53-63e1b96b6dff" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 582.542035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0d63201-3840-43bf-8b53-63e1b96b6dff" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 582.542116] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0d63201-3840-43bf-8b53-63e1b96b6dff',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.551942] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0d63201-3840-43bf-8b53-63e1b96b6dff [ 582.552174] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.552303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 582.552369] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 582.552559] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 582.552644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 582.552732] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0d63201-3840-43bf-8b53-63e1b96b6dff already deleted. [ 582.552843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0d63201-3840-43bf-8b53-63e1b96b6dff" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 584.656885] env[61817]: INFO networking_nsxv3.common.synchronization [None req-6a908f2f-948c-4ccb-a1f8-73113bc0d060 None None] Enqueued Resource ID: c9289d55-2655-481e-86a4-96a309a4172b with Priority: HIGHEST for action port [ 584.657135] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9289d55-2655-481e-86a4-96a309a4172b with Priority: HIGHEST for action port [ 584.657689] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.657837] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 584.657890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 584.658092] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 584.658170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 584.658332] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9289d55-2655-481e-86a4-96a309a4172b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.658417] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9289d55-2655-481e-86a4-96a309a4172b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 584.658464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9289d55-2655-481e-86a4-96a309a4172b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 584.658661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9289d55-2655-481e-86a4-96a309a4172b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 584.658737] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9289d55-2655-481e-86a4-96a309a4172b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.670009] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9289d55-2655-481e-86a4-96a309a4172b [ 584.670203] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.670328] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 584.670394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 584.670696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 584.670776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 584.670868] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9289d55-2655-481e-86a4-96a309a4172b already deleted. [ 584.670944] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9289d55-2655-481e-86a4-96a309a4172b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 584.951897] env[61817]: INFO networking_nsxv3.common.synchronization [None req-43e1c9ce-b0d2-44ad-ab89-aa9b92627b0f None None] Enqueued Resource ID: c17c8a22-4fe8-48d6-a752-9763f8375ef6 with Priority: HIGHEST for action port [ 584.951897] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c17c8a22-4fe8-48d6-a752-9763f8375ef6 with Priority: HIGHEST for action port [ 584.951897] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.951897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 584.951897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 584.951897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 584.952251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 584.952251] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-c17c8a22-4fe8-48d6-a752-9763f8375ef6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.952251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c17c8a22-4fe8-48d6-a752-9763f8375ef6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 584.952251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c17c8a22-4fe8-48d6-a752-9763f8375ef6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 584.952251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c17c8a22-4fe8-48d6-a752-9763f8375ef6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 584.952251] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c17c8a22-4fe8-48d6-a752-9763f8375ef6',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.995946] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c17c8a22-4fe8-48d6-a752-9763f8375ef6 [ 584.995946] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.995946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 584.995946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 584.995946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 584.996207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 584.996207] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c17c8a22-4fe8-48d6-a752-9763f8375ef6 already deleted. [ 584.996207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c17c8a22-4fe8-48d6-a752-9763f8375ef6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 586.071686] env[61817]: INFO networking_nsxv3.common.synchronization [None req-29c29164-d27e-477d-bcdc-968008e491ae tempest-ServersTestJSON-63797321 tempest-ServersTestJSON-63797321-project-member] Enqueued Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGHEST for action security_group_rules [ 586.071686] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGHEST for action security_group_rules [ 586.071686] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.071686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 586.071686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 586.071686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 586.072170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 586.072170] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.072170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 586.072170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 586.072170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 586.072170] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.132448] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.132448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 586.132448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 586.132448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 586.132670] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 586.132670] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 already deleted. [ 586.132670] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 586.382359] env[61817]: INFO networking_nsxv3.common.synchronization [None req-8a33ba61-4753-44c2-85cd-3158d6c8a683 tempest-ServersTestJSON-63797321 tempest-ServersTestJSON-63797321-project-member] Enqueued Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGHEST for action security_group_rules [ 586.383161] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGHEST for action security_group_rules [ 586.383490] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.383603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 586.383667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 586.383862] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 586.383940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 586.384095] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.384187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 586.384247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 586.384412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 586.384500] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.517309] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.517464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 586.517532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 586.517749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 586.517842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 586.517936] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 already deleted. [ 586.518017] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 586.823051] env[61817]: INFO networking_nsxv3.common.synchronization [None req-b45d9ca8-61d7-446b-b80b-2dc204e9b2d8 None None] Enqueued Resource ID: 47ac7a23-e336-4d7f-a7ba-814030f200cd with Priority: HIGHEST for action port [ 586.823051] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ac7a23-e336-4d7f-a7ba-814030f200cd with Priority: HIGHEST for action port [ 586.823051] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.823051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 586.823051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 586.823051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 586.823336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 586.823336] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-47ac7a23-e336-4d7f-a7ba-814030f200cd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.823336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47ac7a23-e336-4d7f-a7ba-814030f200cd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 586.823336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47ac7a23-e336-4d7f-a7ba-814030f200cd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 586.823336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47ac7a23-e336-4d7f-a7ba-814030f200cd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 586.823336] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47ac7a23-e336-4d7f-a7ba-814030f200cd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.850389] env[61817]: INFO networking_nsxv3.common.synchronization [None req-9a1eed22-665b-44d0-9290-a5008601db31 None None] Enqueued Resource ID: 74b9f52a-68be-45bb-ac10-1929f3d7fbae with Priority: HIGHEST for action port [ 586.850686] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74b9f52a-68be-45bb-ac10-1929f3d7fbae with Priority: HIGHEST for action port [ 586.851256] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.851383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 586.851454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 586.851690] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 586.851779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 586.851967] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-74b9f52a-68be-45bb-ac10-1929f3d7fbae taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.852136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74b9f52a-68be-45bb-ac10-1929f3d7fbae" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 586.852136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74b9f52a-68be-45bb-ac10-1929f3d7fbae" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 586.853094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74b9f52a-68be-45bb-ac10-1929f3d7fbae" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 586.853094] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74b9f52a-68be-45bb-ac10-1929f3d7fbae',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.869734] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74b9f52a-68be-45bb-ac10-1929f3d7fbae [ 586.869962] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.870302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 586.870302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 586.870431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 586.870545] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 586.870660] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74b9f52a-68be-45bb-ac10-1929f3d7fbae already deleted. [ 586.870751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74b9f52a-68be-45bb-ac10-1929f3d7fbae" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 586.931039] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47ac7a23-e336-4d7f-a7ba-814030f200cd [ 586.931239] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.931386] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 586.931441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 586.931674] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 586.931772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 586.931867] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47ac7a23-e336-4d7f-a7ba-814030f200cd already deleted. [ 586.931949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47ac7a23-e336-4d7f-a7ba-814030f200cd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.806500] env[61817]: INFO networking_nsxv3.common.synchronization [None req-54b8a87b-3a3a-4539-ac67-3396c8c3bb66 None None] Enqueued Resource ID: 9b3fc51c-e7f0-41ec-bdf6-78f9e9f583b7 with Priority: HIGHEST for action port [ 589.806769] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b3fc51c-e7f0-41ec-bdf6-78f9e9f583b7 with Priority: HIGHEST for action port [ 589.807330] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.807454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.807580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.808091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.808091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.808091] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b3fc51c-e7f0-41ec-bdf6-78f9e9f583b7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.808091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b3fc51c-e7f0-41ec-bdf6-78f9e9f583b7" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.808296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b3fc51c-e7f0-41ec-bdf6-78f9e9f583b7" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.808330] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b3fc51c-e7f0-41ec-bdf6-78f9e9f583b7" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.808388] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b3fc51c-e7f0-41ec-bdf6-78f9e9f583b7',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.843696] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b3fc51c-e7f0-41ec-bdf6-78f9e9f583b7 [ 589.843696] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.843696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 589.843696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 589.843696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 589.843992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 589.843992] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b3fc51c-e7f0-41ec-bdf6-78f9e9f583b7 already deleted. [ 589.843992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b3fc51c-e7f0-41ec-bdf6-78f9e9f583b7" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.307724] env[61817]: INFO networking_nsxv3.common.synchronization [None req-b6ce0f7e-5ce0-432e-adde-0daa55243689 None None] Enqueued Resource ID: a91adf4d-ee03-4eae-9f24-7d366dbb1917 with Priority: HIGHEST for action port [ 591.307999] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a91adf4d-ee03-4eae-9f24-7d366dbb1917 with Priority: HIGHEST for action port [ 591.308595] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.308731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.308797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.308994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.309073] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.309226] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-a91adf4d-ee03-4eae-9f24-7d366dbb1917 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.309318] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a91adf4d-ee03-4eae-9f24-7d366dbb1917" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.309376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a91adf4d-ee03-4eae-9f24-7d366dbb1917" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.309565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a91adf4d-ee03-4eae-9f24-7d366dbb1917" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.309642] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a91adf4d-ee03-4eae-9f24-7d366dbb1917',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.321894] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a91adf4d-ee03-4eae-9f24-7d366dbb1917 [ 591.322115] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.322264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.322326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.322569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.322668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.322759] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a91adf4d-ee03-4eae-9f24-7d366dbb1917 already deleted. [ 591.322840] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a91adf4d-ee03-4eae-9f24-7d366dbb1917" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.914187] env[61817]: INFO networking_nsxv3.common.synchronization [None req-110cdd87-2662-4268-aef4-64c981ef3353 None None] Enqueued Resource ID: 457158e1-42a4-446a-8ed7-4d2466734f41 with Priority: HIGHEST for action port [ 591.914435] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457158e1-42a4-446a-8ed7-4d2466734f41 with Priority: HIGHEST for action port [ 591.915055] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.915138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.915212] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.915395] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.915478] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.915623] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-457158e1-42a4-446a-8ed7-4d2466734f41 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.915715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-457158e1-42a4-446a-8ed7-4d2466734f41" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.915772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-457158e1-42a4-446a-8ed7-4d2466734f41" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.915970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-457158e1-42a4-446a-8ed7-4d2466734f41" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.916074] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457158e1-42a4-446a-8ed7-4d2466734f41',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.946244] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 457158e1-42a4-446a-8ed7-4d2466734f41 [ 591.946459] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.946591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 591.946659] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 591.946860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 591.946947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 591.947055] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:457158e1-42a4-446a-8ed7-4d2466734f41 already deleted. [ 591.947118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-457158e1-42a4-446a-8ed7-4d2466734f41" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 592.002868] env[61817]: INFO networking_nsxv3.common.synchronization [None req-ba28daeb-1882-4864-a261-02334c14fc85 None None] Enqueued Resource ID: 04de49d8-d00f-41f0-b446-1f5f6b5ff0ca with Priority: HIGHEST for action port [ 592.003126] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04de49d8-d00f-41f0-b446-1f5f6b5ff0ca with Priority: HIGHEST for action port [ 592.003683] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.003814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 592.003886] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 592.004110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 592.004197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 592.004372] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-04de49d8-d00f-41f0-b446-1f5f6b5ff0ca taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.004438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04de49d8-d00f-41f0-b446-1f5f6b5ff0ca" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 592.004500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04de49d8-d00f-41f0-b446-1f5f6b5ff0ca" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 592.004760] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04de49d8-d00f-41f0-b446-1f5f6b5ff0ca" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 592.004760] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04de49d8-d00f-41f0-b446-1f5f6b5ff0ca',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.120716] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04de49d8-d00f-41f0-b446-1f5f6b5ff0ca [ 592.120716] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.120716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 592.120716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 592.120716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 592.120962] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 592.120962] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04de49d8-d00f-41f0-b446-1f5f6b5ff0ca already deleted. [ 592.120962] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04de49d8-d00f-41f0-b446-1f5f6b5ff0ca" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 592.957715] env[61817]: INFO networking_nsxv3.common.synchronization [None req-f4952256-e8a0-4050-9dd9-ed3a05839bf8 None None] Enqueued Resource ID: 6951a15d-c752-4ea1-9be4-6871836c3aa8 with Priority: HIGHEST for action port [ 592.957971] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6951a15d-c752-4ea1-9be4-6871836c3aa8 with Priority: HIGHEST for action port [ 592.958537] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.958729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 592.958729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 592.958914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 592.958995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 592.959142] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-6951a15d-c752-4ea1-9be4-6871836c3aa8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.959232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6951a15d-c752-4ea1-9be4-6871836c3aa8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 592.959290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6951a15d-c752-4ea1-9be4-6871836c3aa8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 592.959470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6951a15d-c752-4ea1-9be4-6871836c3aa8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 592.959552] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6951a15d-c752-4ea1-9be4-6871836c3aa8',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.971225] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6951a15d-c752-4ea1-9be4-6871836c3aa8 [ 592.971447] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.972273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 592.972273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 592.972273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 592.972273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 592.972273] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6951a15d-c752-4ea1-9be4-6871836c3aa8 already deleted. [ 592.972273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6951a15d-c752-4ea1-9be4-6871836c3aa8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.294415] env[61817]: INFO networking_nsxv3.common.synchronization [None req-badece31-941d-45ff-b37b-6709a133a01d tempest-ServerActionsTestOtherA-130325156 tempest-ServerActionsTestOtherA-130325156-project-member] Enqueued Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGHEST for action security_group_rules [ 593.294415] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGHEST for action security_group_rules [ 593.294595] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.294742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.294809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.295009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.295091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.295258] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.295353] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.295440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.295585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.295660] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.343150] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.343419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.343419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.343693] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.343756] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.343862] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1266a9f5-7050-4473-ad65-329e9724ea7d already deleted. [ 593.343972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.399867] env[61817]: INFO networking_nsxv3.common.synchronization [req-4b0c7b35-b6ff-485d-bd95-eb24e2ad10cd req-a7771d0b-3e21-4de4-a13d-9636b771efda tempest-ServersTestJSON-63797321 tempest-ServersTestJSON-63797321-project-member] Enqueued Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGHEST for action security_group_members [ 593.400134] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGHEST for action security_group_members [ 593.400729] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.400883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.400919] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.401120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.401197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.401349] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.401442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.401524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.401976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.402211] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.402211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.402316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.402423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.402506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.402596] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.427232] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.427232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.427232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.427232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.427232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.427447] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.427447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.427447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.427447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.427646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.427646] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 already deleted. [ 593.427646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.637567] env[61817]: INFO networking_nsxv3.common.synchronization [None req-05060fe9-120c-4857-a035-e0e0f5080e56 tempest-ServerActionsTestOtherA-130325156 tempest-ServerActionsTestOtherA-130325156-project-member] Enqueued Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGHEST for action security_group_rules [ 593.637819] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGHEST for action security_group_rules [ 593.638473] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.638614] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.638680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.638881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.638965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.639115] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.639210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.639272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.639416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.639491] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.677763] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.677763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 593.677763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 593.677763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 593.678169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 593.678169] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1266a9f5-7050-4473-ad65-329e9724ea7d already deleted. [ 593.678169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.161782] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.162136] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.162136] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.162337] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.162493] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.162766] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-574 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.162935] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-574" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.163050] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-574" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.163307] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-574" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.164023] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.164023] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.165161] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.165161] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.165161] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.165161] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-574" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.165381] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.165381] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.165545] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.165703] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.165926] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.166316] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-af761ca4-c9e4-4908-9053-119f8438c1a2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.166682] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-af761ca4-c9e4-4908-9053-119f8438c1a2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.166934] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-af761ca4-c9e4-4908-9053-119f8438c1a2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.167791] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-af761ca4-c9e4-4908-9053-119f8438c1a2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.167791] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af761ca4-c9e4-4908-9053-119f8438c1a2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.194470] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.194705] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.194851] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.195135] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.196562] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.196562] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port af761ca4-c9e4-4908-9053-119f8438c1a2 not found, creating... [ 594.196765] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.196855] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.196855] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.196855] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.196855] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.196995] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.196995] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.197115] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.197572] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.197572] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.197572] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: af761ca4-c9e4-4908-9053-119f8438c1a2 is going to be created. [ 594.226487] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.226699] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.226851] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.227117] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.227342] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.227674] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-af761ca4-c9e4-4908-9053-119f8438c1a2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.828319] env[61817]: INFO networking_nsxv3.common.synchronization [req-4b0c7b35-b6ff-485d-bd95-eb24e2ad10cd req-86f95e95-67a1-4c9e-ad7b-1bc9101cb43c service neutron] Enqueued Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGHEST for action security_group_rules [ 594.828828] env[61817]: INFO networking_nsxv3.common.synchronization [req-4b0c7b35-b6ff-485d-bd95-eb24e2ad10cd req-86f95e95-67a1-4c9e-ad7b-1bc9101cb43c service neutron] Enqueued Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGHEST for action security_group_members [ 594.828979] env[61817]: INFO networking_nsxv3.common.synchronization [req-4b0c7b35-b6ff-485d-bd95-eb24e2ad10cd req-86f95e95-67a1-4c9e-ad7b-1bc9101cb43c service neutron] Enqueued Resource ID: af761ca4-c9e4-4908-9053-119f8438c1a2 with Priority: HIGHEST for action port [ 594.829197] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGHEST for action security_group_rules [ 594.829321] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGHEST for action security_group_members [ 594.829413] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af761ca4-c9e4-4908-9053-119f8438c1a2 with Priority: HIGHEST for action port [ 594.829961] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.830083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.830148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.830346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.830428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.830646] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.830741] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.830800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.831161] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.831161] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.831907] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.831964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.832080] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.832199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.832276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.832416] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.832506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.832563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.832722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.832900] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.832950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.832998] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.833132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.833206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.833290] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.834297] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.834395] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.834457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.834613] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.834686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.834851] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-af761ca4-c9e4-4908-9053-119f8438c1a2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.834954] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af761ca4-c9e4-4908-9053-119f8438c1a2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.835013] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af761ca4-c9e4-4908-9053-119f8438c1a2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.835151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af761ca4-c9e4-4908-9053-119f8438c1a2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.835429] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af761ca4-c9e4-4908-9053-119f8438c1a2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.860862] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.861068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.861164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.861411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.861751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.861921] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.862120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.873983] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.911327] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af761ca4-c9e4-4908-9053-119f8438c1a2 with status ACTIVE [ 594.911713] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.911949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.912040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.912275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.912363] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.912529] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.912748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.912896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.913061] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.913137] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.935924] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.954897] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.955123] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 594.955123] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 594.955311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 594.955400] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 594.955491] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 is going to be created. [ 594.999848] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.999998] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 595.000069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 595.000271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 595.000430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 595.014145] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 in Status: UNINITIALIZED for 2s [ 595.300619] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.301021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 595.301021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 595.301094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 595.301144] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 595.301236] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af761ca4-c9e4-4908-9053-119f8438c1a2 is going to be updated. [ 595.324298] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.324441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 595.324531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 595.324744] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 595.324878] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 595.325071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af761ca4-c9e4-4908-9053-119f8438c1a2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 595.550648] env[61817]: INFO networking_nsxv3.common.synchronization [None req-2b192d8e-6341-4cde-a710-7426d18c2eec None None] Enqueued Resource ID: c1839da3-73da-4699-b3e9-878b757dce2f with Priority: HIGHEST for action port [ 595.550912] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1839da3-73da-4699-b3e9-878b757dce2f with Priority: HIGHEST for action port [ 595.551496] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.551664] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 595.551735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 595.551985] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 595.552091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 595.552260] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1839da3-73da-4699-b3e9-878b757dce2f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.552383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1839da3-73da-4699-b3e9-878b757dce2f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 595.552445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1839da3-73da-4699-b3e9-878b757dce2f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 595.552651] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1839da3-73da-4699-b3e9-878b757dce2f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 595.552728] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1839da3-73da-4699-b3e9-878b757dce2f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.574483] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1839da3-73da-4699-b3e9-878b757dce2f [ 595.574690] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.574835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 595.574887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 595.575081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 595.575164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 595.575251] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1839da3-73da-4699-b3e9-878b757dce2f already deleted. [ 595.575328] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1839da3-73da-4699-b3e9-878b757dce2f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.024752] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 in Status: SUCCESS [ 597.025062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.025148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.025361] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.025547] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.025671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.025788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.025886] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.025999] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.026039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.026124] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.045016] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.062034] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9efe5fcd-faf9-44dd-ac10-abd106d2dc72: rpc.has_security_group_logging(os_id): False [ 597.087475] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.087475] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.087752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.087799] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.087896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.088246] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.088375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.088413] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.088694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.088694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.088785] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 is going to be created. [ 597.176374] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.176374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.176374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.176374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.176374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.193742] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 in Status: IN_PROGRESS for 2s [ 597.546692] env[61817]: INFO networking_nsxv3.common.synchronization [None req-6391cfe5-9fca-418a-b1f8-de58fde91381 tempest-VolumesAssistedSnapshotsTest-1225995952 tempest-VolumesAssistedSnapshotsTest-1225995952-project-member] Enqueued Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGHEST for action security_group_rules [ 597.546692] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGHEST for action security_group_rules [ 597.546692] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.546692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.546692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.546692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.546692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.546692] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.546692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.546692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.546692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.546692] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.581912] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.581912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 597.581912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 597.581912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 597.581912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 597.581912] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 already deleted. [ 597.581912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 598.088604] env[61817]: INFO networking_nsxv3.common.synchronization [None req-b122551a-25d9-4ff6-b3cd-0660493bc775 tempest-VolumesAssistedSnapshotsTest-1225995952 tempest-VolumesAssistedSnapshotsTest-1225995952-project-member] Enqueued Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGHEST for action security_group_rules [ 598.088604] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGHEST for action security_group_rules [ 598.088604] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.088604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 598.088604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 598.088999] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 598.088999] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 598.088999] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.089109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 598.089161] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 598.089316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 598.089393] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.123095] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.123280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 598.123326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 598.123521] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 598.123643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 598.123744] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 already deleted. [ 598.123834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 599.207752] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 in Status: SUCCESS [ 599.208063] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 600.989208] env[61817]: INFO networking_nsxv3.common.synchronization [None req-c0cd1892-e7e1-4ebb-9e17-62b05acd8f35 None None] Enqueued Resource ID: 5b382eb6-bcbe-4e76-9c8e-20e2e77f5fea with Priority: HIGHEST for action port [ 600.989509] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b382eb6-bcbe-4e76-9c8e-20e2e77f5fea with Priority: HIGHEST for action port [ 600.990375] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.990617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 600.990765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 600.990989] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 600.991079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 600.991305] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b382eb6-bcbe-4e76-9c8e-20e2e77f5fea taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.991419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b382eb6-bcbe-4e76-9c8e-20e2e77f5fea" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 600.991498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b382eb6-bcbe-4e76-9c8e-20e2e77f5fea" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 600.991725] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b382eb6-bcbe-4e76-9c8e-20e2e77f5fea" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 600.991811] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b382eb6-bcbe-4e76-9c8e-20e2e77f5fea',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.216752] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b382eb6-bcbe-4e76-9c8e-20e2e77f5fea [ 601.216752] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.216752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 601.216752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 601.216752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 601.216752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 601.216752] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b382eb6-bcbe-4e76-9c8e-20e2e77f5fea already deleted. [ 601.216752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b382eb6-bcbe-4e76-9c8e-20e2e77f5fea" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 601.871141] env[61817]: INFO networking_nsxv3.common.synchronization [None req-8533478f-0cfd-4007-9b9d-b8a932be1b5e None None] Enqueued Resource ID: f6ef277c-f03d-44c2-a6e5-a2bdf9a2f4d4 with Priority: HIGHEST for action port [ 601.871141] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6ef277c-f03d-44c2-a6e5-a2bdf9a2f4d4 with Priority: HIGHEST for action port [ 601.871141] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.871141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 601.871141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 601.871141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 601.871141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 601.871141] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6ef277c-f03d-44c2-a6e5-a2bdf9a2f4d4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.871141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6ef277c-f03d-44c2-a6e5-a2bdf9a2f4d4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 601.871141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6ef277c-f03d-44c2-a6e5-a2bdf9a2f4d4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 601.871141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6ef277c-f03d-44c2-a6e5-a2bdf9a2f4d4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 601.871141] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6ef277c-f03d-44c2-a6e5-a2bdf9a2f4d4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.922230] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6ef277c-f03d-44c2-a6e5-a2bdf9a2f4d4 [ 601.922545] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.922649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 601.922704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 601.922922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 601.923011] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 601.923106] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6ef277c-f03d-44c2-a6e5-a2bdf9a2f4d4 already deleted. [ 601.923185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6ef277c-f03d-44c2-a6e5-a2bdf9a2f4d4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.279423] env[61817]: INFO networking_nsxv3.common.synchronization [None req-576d0957-2f8d-439c-88fe-24ac5d4381fb None None] Enqueued Resource ID: 7bef407b-30a5-4ae5-a5c3-75f51218a925 with Priority: HIGHEST for action port [ 602.279719] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bef407b-30a5-4ae5-a5c3-75f51218a925 with Priority: HIGHEST for action port [ 602.280259] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.280390] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.280457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.280685] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.280772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.280929] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bef407b-30a5-4ae5-a5c3-75f51218a925 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.281031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bef407b-30a5-4ae5-a5c3-75f51218a925" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.281093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bef407b-30a5-4ae5-a5c3-75f51218a925" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.281296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bef407b-30a5-4ae5-a5c3-75f51218a925" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.281378] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bef407b-30a5-4ae5-a5c3-75f51218a925',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.299218] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bef407b-30a5-4ae5-a5c3-75f51218a925 [ 602.299218] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.299218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.299218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.299218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.299218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.299218] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bef407b-30a5-4ae5-a5c3-75f51218a925 already deleted. [ 602.299218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bef407b-30a5-4ae5-a5c3-75f51218a925" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.624072] env[61817]: INFO networking_nsxv3.common.synchronization [req-d4759bab-05e0-4783-b926-37c5813981aa req-97964dd1-82d9-4a38-a90a-28b4be61c64a tempest-ServerActionsTestOtherA-130325156 tempest-ServerActionsTestOtherA-130325156-project-member] Enqueued Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGHEST for action security_group_members [ 602.624623] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGHEST for action security_group_members [ 602.624985] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.625127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.625195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.625400] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.625485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.625645] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.625740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.625804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.626039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.626186] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.626303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.626349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.626474] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.626552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.626644] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.641129] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.641287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.641404] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.641739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.641739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.641880] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.641985] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.642053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.642245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.642326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.642408] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1266a9f5-7050-4473-ad65-329e9724ea7d already deleted. [ 602.642492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.771483] env[61817]: INFO networking_nsxv3.common.synchronization [None req-1caa9e33-a94d-470b-a0ef-5f61270c2f71 None None] Enqueued Resource ID: 494c8b96-f41a-4d70-be77-51bd9494e338 with Priority: HIGHEST for action port [ 602.771670] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494c8b96-f41a-4d70-be77-51bd9494e338 with Priority: HIGHEST for action port [ 602.772236] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.772687] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.772687] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.772687] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.772824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.772857] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-494c8b96-f41a-4d70-be77-51bd9494e338 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.773020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-494c8b96-f41a-4d70-be77-51bd9494e338" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.773020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-494c8b96-f41a-4d70-be77-51bd9494e338" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.773196] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-494c8b96-f41a-4d70-be77-51bd9494e338" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.773272] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('494c8b96-f41a-4d70-be77-51bd9494e338',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.790656] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 494c8b96-f41a-4d70-be77-51bd9494e338 [ 602.791016] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.791016] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 602.791157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 602.791275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 602.791365] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 602.791951] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:494c8b96-f41a-4d70-be77-51bd9494e338 already deleted. [ 602.791951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-494c8b96-f41a-4d70-be77-51bd9494e338" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.974737] env[61817]: INFO networking_nsxv3.common.synchronization [None req-e3ffc3ff-494a-4101-bdbd-5a7901623fe3 None None] Enqueued Resource ID: b5ad3b12-ea59-45f5-8bc2-042b18f883fc with Priority: HIGHEST for action port [ 603.974737] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5ad3b12-ea59-45f5-8bc2-042b18f883fc with Priority: HIGHEST for action port [ 603.974737] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.974737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.974737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.974737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.974737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 603.974737] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5ad3b12-ea59-45f5-8bc2-042b18f883fc taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.974737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5ad3b12-ea59-45f5-8bc2-042b18f883fc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 603.975375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5ad3b12-ea59-45f5-8bc2-042b18f883fc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 603.975375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5ad3b12-ea59-45f5-8bc2-042b18f883fc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 603.975375] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5ad3b12-ea59-45f5-8bc2-042b18f883fc',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.105281] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5ad3b12-ea59-45f5-8bc2-042b18f883fc [ 604.105501] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.105629] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.105695] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.105893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.105975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.106087] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5ad3b12-ea59-45f5-8bc2-042b18f883fc already deleted. [ 604.106165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5ad3b12-ea59-45f5-8bc2-042b18f883fc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.124795] env[61817]: INFO networking_nsxv3.common.synchronization [None req-28eecd0f-424d-4f0c-b173-7c9ecf434c94 None None] Enqueued Resource ID: d67fc503-75ac-4eaf-9068-22f9be334200 with Priority: HIGHEST for action port [ 604.125394] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d67fc503-75ac-4eaf-9068-22f9be334200 with Priority: HIGHEST for action port [ 604.126149] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.126149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.126149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.126381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.126520] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.126704] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-d67fc503-75ac-4eaf-9068-22f9be334200 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.126842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d67fc503-75ac-4eaf-9068-22f9be334200" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.127622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d67fc503-75ac-4eaf-9068-22f9be334200" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.127859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d67fc503-75ac-4eaf-9068-22f9be334200" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.127953] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d67fc503-75ac-4eaf-9068-22f9be334200',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.158311] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d67fc503-75ac-4eaf-9068-22f9be334200 [ 604.158531] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.158651] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.158715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.158919] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.159003] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.159092] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d67fc503-75ac-4eaf-9068-22f9be334200 already deleted. [ 604.159169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d67fc503-75ac-4eaf-9068-22f9be334200" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.820907] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.821019] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.821143] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.821551] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.821618] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.821818] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-601 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.821976] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-601" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.822081] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-601" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.822335] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-601" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.822576] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.822726] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.822836] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.823036] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.823682] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.823921] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-601" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.824269] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.824457] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.824585] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.824799] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.824946] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.825160] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-7ef38466-6323-45ab-a015-6bf146d59bbd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.825306] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-7ef38466-6323-45ab-a015-6bf146d59bbd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.825418] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-7ef38466-6323-45ab-a015-6bf146d59bbd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.825664] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-7ef38466-6323-45ab-a015-6bf146d59bbd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.825798] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ef38466-6323-45ab-a015-6bf146d59bbd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.842289] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.842513] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.842630] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.842906] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.843043] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.843186] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 7ef38466-6323-45ab-a015-6bf146d59bbd not found, creating... [ 604.843432] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.843584] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.843695] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.843899] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.844036] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.844312] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.844458] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.844576] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.844774] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.844894] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.845039] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 7ef38466-6323-45ab-a015-6bf146d59bbd is going to be created. [ 604.869600] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.869827] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 604.869927] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 604.870198] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 604.870426] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 604.870711] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-7ef38466-6323-45ab-a015-6bf146d59bbd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.173727] env[61817]: INFO networking_nsxv3.common.synchronization [None req-be45fc82-8b8e-4b23-a69f-5bc314069270 tempest-ServersWithSpecificFlavorTestJSON-818828595 tempest-ServersWithSpecificFlavorTestJSON-818828595-project-member] Enqueued Resource ID: 063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d with Priority: HIGHEST for action security_group_rules [ 606.174254] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d with Priority: HIGHEST for action security_group_rules [ 606.174611] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.174759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.174818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.175036] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.175115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.175261] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.175354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.175412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.175614] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.175686] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.276122] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.276314] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.276363] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.276572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.276613] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.276699] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d already deleted. [ 606.276775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.447974] env[61817]: INFO networking_nsxv3.common.synchronization [None req-9c9aeed9-4ac0-41a6-84eb-d6f880279f7d tempest-ServersWithSpecificFlavorTestJSON-818828595 tempest-ServersWithSpecificFlavorTestJSON-818828595-project-member] Enqueued Resource ID: 063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d with Priority: HIGHEST for action security_group_rules [ 606.448582] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d with Priority: HIGHEST for action security_group_rules [ 606.448915] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.449077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.449129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.449336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.449425] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.449575] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.449680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.449754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.449906] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.449987] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.503263] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.503456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.503522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.503683] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.503785] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.503876] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d already deleted. [ 606.503956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-063ed7ad-0ddb-4aaa-b7b7-0700bfc30b3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.586392] env[61817]: INFO networking_nsxv3.common.synchronization [None req-530e4248-49a8-4156-82c0-ed8f01057617 None None] Enqueued Resource ID: f68fbaf2-736d-4f5a-84fb-9eda10a78aaa with Priority: HIGHEST for action port [ 606.586469] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f68fbaf2-736d-4f5a-84fb-9eda10a78aaa with Priority: HIGHEST for action port [ 606.587028] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.587256] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.587256] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.587421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.587503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.587661] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f68fbaf2-736d-4f5a-84fb-9eda10a78aaa taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.587749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f68fbaf2-736d-4f5a-84fb-9eda10a78aaa" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.587792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f68fbaf2-736d-4f5a-84fb-9eda10a78aaa" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.587974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f68fbaf2-736d-4f5a-84fb-9eda10a78aaa" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.588064] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f68fbaf2-736d-4f5a-84fb-9eda10a78aaa',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.607638] env[61817]: INFO networking_nsxv3.common.synchronization [req-98f9f9ab-af76-495c-afea-16520da4f1c5 req-f7e3cd97-537b-4b41-9e89-195a05e78ac1 tempest-VolumesAssistedSnapshotsTest-1225995952 tempest-VolumesAssistedSnapshotsTest-1225995952-project-member] Enqueued Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGHEST for action security_group_members [ 606.607638] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGHEST for action security_group_members [ 606.607638] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.607638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.607638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.607638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.607638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.607638] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.607638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.607638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.607638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.607638] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.607638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.607638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.607638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.607638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.607638] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.646796] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f68fbaf2-736d-4f5a-84fb-9eda10a78aaa [ 606.647009] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.648239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.648239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.648239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.648239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.648239] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f68fbaf2-736d-4f5a-84fb-9eda10a78aaa already deleted. [ 606.648239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f68fbaf2-736d-4f5a-84fb-9eda10a78aaa" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.652840] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.652991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.653045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.653233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.653321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.653499] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.653595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.653656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.653805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.653882] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.653964] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 already deleted. [ 606.654041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.906676] env[61817]: INFO networking_nsxv3.common.synchronization [None req-a21e0931-3e6d-49a2-9d70-573904a02152 None None] Enqueued Resource ID: 771b7fca-321e-4f16-89a6-c0ef34a182a0 with Priority: HIGHEST for action port [ 606.906794] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 771b7fca-321e-4f16-89a6-c0ef34a182a0 with Priority: HIGHEST for action port [ 606.910349] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.910482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.910570] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.910767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.910848] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.911007] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-771b7fca-321e-4f16-89a6-c0ef34a182a0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.911099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-771b7fca-321e-4f16-89a6-c0ef34a182a0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.911158] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-771b7fca-321e-4f16-89a6-c0ef34a182a0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.911332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-771b7fca-321e-4f16-89a6-c0ef34a182a0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.911411] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('771b7fca-321e-4f16-89a6-c0ef34a182a0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.913177] env[61817]: INFO networking_nsxv3.common.synchronization [req-d4759bab-05e0-4783-b926-37c5813981aa req-1514cc65-e382-4518-a333-807c409c8eba service neutron] Enqueued Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGHEST for action security_group_rules [ 606.913339] env[61817]: INFO networking_nsxv3.common.synchronization [req-d4759bab-05e0-4783-b926-37c5813981aa req-1514cc65-e382-4518-a333-807c409c8eba service neutron] Enqueued Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGHEST for action security_group_members [ 606.913479] env[61817]: INFO networking_nsxv3.common.synchronization [req-d4759bab-05e0-4783-b926-37c5813981aa req-1514cc65-e382-4518-a333-807c409c8eba service neutron] Enqueued Resource ID: 7ef38466-6323-45ab-a015-6bf146d59bbd with Priority: HIGHEST for action port [ 606.914229] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGHEST for action security_group_rules [ 606.914433] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGHEST for action security_group_members [ 606.914471] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef38466-6323-45ab-a015-6bf146d59bbd with Priority: HIGHEST for action port [ 606.914806] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.914880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.914880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.921204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.921204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.921204] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.921204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.921204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.921204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.921204] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.922792] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.922898] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.922964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.923120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.923265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.923418] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.923480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.923516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.923653] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.923792] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.923880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.923940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.924220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.924220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.924316] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.925663] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.925837] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.925837] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.926005] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.926062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.926203] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ef38466-6323-45ab-a015-6bf146d59bbd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.926287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ef38466-6323-45ab-a015-6bf146d59bbd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.926353] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ef38466-6323-45ab-a015-6bf146d59bbd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.926496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ef38466-6323-45ab-a015-6bf146d59bbd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.926577] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ef38466-6323-45ab-a015-6bf146d59bbd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.933467] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 771b7fca-321e-4f16-89a6-c0ef34a182a0 [ 606.933666] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.933792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.933859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.934110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.934178] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.934217] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:771b7fca-321e-4f16-89a6-c0ef34a182a0 already deleted. [ 606.934477] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-771b7fca-321e-4f16-89a6-c0ef34a182a0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.953708] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.956133] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.956271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.956325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.956635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.956635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.956812] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.956878] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.967320] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ef38466-6323-45ab-a015-6bf146d59bbd with status ACTIVE [ 606.967444] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.967583] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.967644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.967838] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.967921] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.968098] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.968194] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.968248] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.968412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.968515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.972678] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.983336] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.983491] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 606.983558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 606.983757] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 606.983956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 606.984056] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1266a9f5-7050-4473-ad65-329e9724ea7d is going to be created. [ 607.037258] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.037414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.037487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.037694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.037857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.052676] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1266a9f5-7050-4473-ad65-329e9724ea7d in Status: UNINITIALIZED for 2s [ 607.371428] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.371858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.371858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.371858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.371963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.371995] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ef38466-6323-45ab-a015-6bf146d59bbd is going to be updated. [ 607.395432] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.395595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.395595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.395811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.395945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.396126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ef38466-6323-45ab-a015-6bf146d59bbd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.721112] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.721112] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.721112] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.721112] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.721112] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.721112] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-416 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.721112] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-416" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.721112] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-416" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.721112] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-416" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.722113] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.722113] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.722113] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.722113] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.722113] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.722113] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-416" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.722113] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.722113] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.722113] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.722113] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.722113] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.722535] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-962e2556-54e1-4677-bf83-97889db7f5cc taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.722535] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-962e2556-54e1-4677-bf83-97889db7f5cc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.722535] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-962e2556-54e1-4677-bf83-97889db7f5cc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.722535] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-962e2556-54e1-4677-bf83-97889db7f5cc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.722535] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('962e2556-54e1-4677-bf83-97889db7f5cc',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.840219] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.840219] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.840528] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.840708] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.840873] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.841034] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 962e2556-54e1-4677-bf83-97889db7f5cc not found, creating... [ 607.841318] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.841487] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.841605] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.842034] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.842104] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.842380] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.842540] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.842651] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.843270] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.843270] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.843270] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 962e2556-54e1-4677-bf83-97889db7f5cc is going to be created. [ 607.866149] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.866394] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 607.866521] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 607.866800] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 607.867394] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 607.867394] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-962e2556-54e1-4677-bf83-97889db7f5cc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.439092] env[61817]: INFO networking_nsxv3.common.synchronization [None req-c9d23a66-4b5c-4219-b035-7c7343b1bf1a None None] Enqueued Resource ID: c4c60386-c924-458a-84cd-74b332488074 with Priority: HIGHEST for action port [ 608.439351] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4c60386-c924-458a-84cd-74b332488074 with Priority: HIGHEST for action port [ 608.439929] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.440069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.440135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.440391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.440427] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.440615] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4c60386-c924-458a-84cd-74b332488074 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.440754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4c60386-c924-458a-84cd-74b332488074" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.440827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4c60386-c924-458a-84cd-74b332488074" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.441033] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4c60386-c924-458a-84cd-74b332488074" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.441113] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4c60386-c924-458a-84cd-74b332488074',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.493471] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4c60386-c924-458a-84cd-74b332488074 [ 608.493699] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.493838] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.493904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.494109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.494195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.494282] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4c60386-c924-458a-84cd-74b332488074 already deleted. [ 608.494358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4c60386-c924-458a-84cd-74b332488074" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.512330] env[61817]: INFO networking_nsxv3.common.synchronization [req-98f9f9ab-af76-495c-afea-16520da4f1c5 req-e43833a0-3de0-4cd1-af98-38a21ffea0b8 service neutron] Enqueued Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGHEST for action security_group_rules [ 608.512554] env[61817]: INFO networking_nsxv3.common.synchronization [req-98f9f9ab-af76-495c-afea-16520da4f1c5 req-e43833a0-3de0-4cd1-af98-38a21ffea0b8 service neutron] Enqueued Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGHEST for action security_group_members [ 608.512747] env[61817]: INFO networking_nsxv3.common.synchronization [req-98f9f9ab-af76-495c-afea-16520da4f1c5 req-e43833a0-3de0-4cd1-af98-38a21ffea0b8 service neutron] Enqueued Resource ID: 962e2556-54e1-4677-bf83-97889db7f5cc with Priority: HIGHEST for action port [ 608.513215] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGHEST for action security_group_rules [ 608.513346] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGHEST for action security_group_members [ 608.513440] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 962e2556-54e1-4677-bf83-97889db7f5cc with Priority: HIGHEST for action port [ 608.513776] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.513898] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.514013] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.514231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.514321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.514482] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.514572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.514632] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.514861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.514861] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.515976] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.516172] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.516222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.516604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.516604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.516736] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.516789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.516821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.516963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.517098] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.517186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.517251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.517381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.517455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.517535] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.518780] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.518780] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.518780] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.518780] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.518780] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.518966] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-962e2556-54e1-4677-bf83-97889db7f5cc taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.518966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-962e2556-54e1-4677-bf83-97889db7f5cc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.518966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-962e2556-54e1-4677-bf83-97889db7f5cc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.519135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-962e2556-54e1-4677-bf83-97889db7f5cc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.519165] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('962e2556-54e1-4677-bf83-97889db7f5cc',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.558547] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.558751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.558827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.559042] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.559140] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.559316] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.559397] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.680218] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.728560] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.755635] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 962e2556-54e1-4677-bf83-97889db7f5cc with status ACTIVE [ 608.755798] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.755950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.756018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.756274] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.756341] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.756528] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.756630] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.756692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.756833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.756912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.766058] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.766413] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.766413] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.766500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.766533] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.766639] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 is going to be created. [ 608.801675] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.801844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.801914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.802122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.802285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.812766] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 in Status: UNINITIALIZED for 2s [ 608.985810] env[61817]: INFO networking_nsxv3.common.synchronization [None req-c6291b43-3c14-4328-afe5-5fc82f869402 None None] Enqueued Resource ID: 2f58bf67-6865-4ef1-8ebd-85fd32511c29 with Priority: HIGHEST for action port [ 608.986068] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f58bf67-6865-4ef1-8ebd-85fd32511c29 with Priority: HIGHEST for action port [ 608.986664] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.986785] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.986849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.987051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.987133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 608.987279] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f58bf67-6865-4ef1-8ebd-85fd32511c29 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.987607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f58bf67-6865-4ef1-8ebd-85fd32511c29" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 608.987607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f58bf67-6865-4ef1-8ebd-85fd32511c29" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 608.987681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f58bf67-6865-4ef1-8ebd-85fd32511c29" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 608.987714] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f58bf67-6865-4ef1-8ebd-85fd32511c29',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.029125] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f58bf67-6865-4ef1-8ebd-85fd32511c29 [ 609.029125] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.029125] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.029125] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.029125] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.029125] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.029125] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f58bf67-6865-4ef1-8ebd-85fd32511c29 already deleted. [ 609.029125] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f58bf67-6865-4ef1-8ebd-85fd32511c29" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.064043] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1266a9f5-7050-4473-ad65-329e9724ea7d in Status: SUCCESS [ 609.064043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.064043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.064043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.064043] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.064043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.064043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.064043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.064043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.064043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.064043] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.088060] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.094644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.094706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.094903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.094974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.095077] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 962e2556-54e1-4677-bf83-97889db7f5cc is going to be updated. [ 609.120663] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.120808] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.121072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.121072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.121211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.121373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-962e2556-54e1-4677-bf83-97889db7f5cc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.157164] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.275312] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1266a9f5-7050-4473-ad65-329e9724ea7d: rpc.has_security_group_logging(os_id): False [ 609.307479] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.307479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.307598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.307823] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.307863] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.308173] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.308241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.308301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.308557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.308557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.308627] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1266a9f5-7050-4473-ad65-329e9724ea7d is going to be created. [ 609.392451] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.392611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.392720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.393028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.393235] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.409704] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1266a9f5-7050-4473-ad65-329e9724ea7d in Status: IN_PROGRESS for 2s [ 609.473781] env[61817]: INFO networking_nsxv3.common.synchronization [None req-206fa0ae-adf2-47c7-b100-91b463d2995c None None] Enqueued Resource ID: 2fe20d80-2ca2-42fc-bd5b-0a2c7caf44d9 with Priority: HIGHEST for action port [ 609.474369] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe20d80-2ca2-42fc-bd5b-0a2c7caf44d9 with Priority: HIGHEST for action port [ 609.474729] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.474865] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.475631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.475631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.475631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.475631] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fe20d80-2ca2-42fc-bd5b-0a2c7caf44d9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.475631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fe20d80-2ca2-42fc-bd5b-0a2c7caf44d9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.476024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fe20d80-2ca2-42fc-bd5b-0a2c7caf44d9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.476024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fe20d80-2ca2-42fc-bd5b-0a2c7caf44d9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.476132] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fe20d80-2ca2-42fc-bd5b-0a2c7caf44d9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.593273] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fe20d80-2ca2-42fc-bd5b-0a2c7caf44d9 [ 609.593273] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.593273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 609.593273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 609.593273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 609.593273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 609.593273] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fe20d80-2ca2-42fc-bd5b-0a2c7caf44d9 already deleted. [ 609.593273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fe20d80-2ca2-42fc-bd5b-0a2c7caf44d9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 610.822567] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 in Status: SUCCESS [ 610.822952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 610.822995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 610.823191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 610.823375] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.823496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 610.823556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 610.823710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 610.823790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 610.823873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 610.823960] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.846453] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.854027] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 905dd5f8-1bc0-4560-8294-1733c7eaf6f4: rpc.has_security_group_logging(os_id): False [ 610.872069] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.872229] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 610.872299] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 610.872507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 610.872603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 610.872841] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.872935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 610.872987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 610.873199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 610.873199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 610.873334] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 is going to be created. [ 610.932401] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.932630] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 610.932630] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 610.932813] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 610.932996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 610.944682] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 in Status: IN_PROGRESS for 2s [ 611.422645] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1266a9f5-7050-4473-ad65-329e9724ea7d in Status: SUCCESS [ 611.422864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 611.718494] env[61817]: INFO networking_nsxv3.common.synchronization [None req-9843b9cb-d61d-4d80-b78e-0f4c5452ea40 None None] Enqueued Resource ID: 7463963e-4e7a-430b-8050-d23bc2ead351 with Priority: HIGHEST for action port [ 611.718775] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7463963e-4e7a-430b-8050-d23bc2ead351 with Priority: HIGHEST for action port [ 611.719356] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.719603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 611.719603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 611.719787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 611.719827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 611.720050] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-7463963e-4e7a-430b-8050-d23bc2ead351 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.720244] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7463963e-4e7a-430b-8050-d23bc2ead351" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 611.720244] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7463963e-4e7a-430b-8050-d23bc2ead351" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 611.720335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7463963e-4e7a-430b-8050-d23bc2ead351" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 611.720414] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7463963e-4e7a-430b-8050-d23bc2ead351',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.797888] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7463963e-4e7a-430b-8050-d23bc2ead351 [ 611.798108] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.798240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 611.798305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 611.798541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 611.798635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 611.798726] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7463963e-4e7a-430b-8050-d23bc2ead351 already deleted. [ 611.798804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7463963e-4e7a-430b-8050-d23bc2ead351" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 612.112172] env[61817]: INFO networking_nsxv3.common.synchronization [None req-51002aa5-ab5e-4da9-9311-8fa9e01284d9 None None] Enqueued Resource ID: 3a59d9ed-7a01-4deb-88f0-a54be3360083 with Priority: HIGHEST for action port [ 612.112454] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a59d9ed-7a01-4deb-88f0-a54be3360083 with Priority: HIGHEST for action port [ 612.113021] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.113151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 612.113215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 612.113414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 612.113497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 612.113649] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a59d9ed-7a01-4deb-88f0-a54be3360083 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.113860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a59d9ed-7a01-4deb-88f0-a54be3360083" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 612.113860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a59d9ed-7a01-4deb-88f0-a54be3360083" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 612.113978] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a59d9ed-7a01-4deb-88f0-a54be3360083" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 612.114055] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a59d9ed-7a01-4deb-88f0-a54be3360083',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.141511] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a59d9ed-7a01-4deb-88f0-a54be3360083 [ 612.141757] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.141887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 612.141954] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 612.142162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 612.142247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 612.142335] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a59d9ed-7a01-4deb-88f0-a54be3360083 already deleted. [ 612.142410] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a59d9ed-7a01-4deb-88f0-a54be3360083" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 612.957545] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 in Status: SUCCESS [ 612.957771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 613.425189] env[61817]: INFO networking_nsxv3.common.synchronization [req-e4b8fde6-1b73-4afb-8131-5566bf598652 req-830b968c-d48c-4c3a-b7cc-fbd0d5ebcd5e tempest-SecurityGroupRulesTestJSON-1788170182 tempest-SecurityGroupRulesTestJSON-1788170182-project-member] Enqueued Resource ID: 756c6121-6274-465e-a70b-9646c007cfc8 with Priority: HIGHEST for action security_group_rules [ 613.425448] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 756c6121-6274-465e-a70b-9646c007cfc8 with Priority: HIGHEST for action security_group_rules [ 613.425969] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.426097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 613.426156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 613.426345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 613.426423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 613.426790] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-756c6121-6274-465e-a70b-9646c007cfc8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.426906] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-756c6121-6274-465e-a70b-9646c007cfc8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 613.426906] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-756c6121-6274-465e-a70b-9646c007cfc8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 613.427079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-756c6121-6274-465e-a70b-9646c007cfc8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 613.427155] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('756c6121-6274-465e-a70b-9646c007cfc8',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.464711] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.465011] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 613.465011] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 613.465156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 613.465224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 613.465318] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 756c6121-6274-465e-a70b-9646c007cfc8 already deleted. [ 613.465403] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-756c6121-6274-465e-a70b-9646c007cfc8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 614.636414] env[61817]: INFO networking_nsxv3.common.synchronization [None req-6aad3860-1baa-4fe4-b9bb-fcbf40e9062b None None] Enqueued Resource ID: f714d433-51d2-4572-a6eb-cc88baa75a8b with Priority: HIGHEST for action port [ 614.636688] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f714d433-51d2-4572-a6eb-cc88baa75a8b with Priority: HIGHEST for action port [ 614.637260] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.637398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 614.637496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 614.637664] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 614.637751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 614.637914] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f714d433-51d2-4572-a6eb-cc88baa75a8b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.638012] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f714d433-51d2-4572-a6eb-cc88baa75a8b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 614.638072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f714d433-51d2-4572-a6eb-cc88baa75a8b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 614.638264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f714d433-51d2-4572-a6eb-cc88baa75a8b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 614.638345] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f714d433-51d2-4572-a6eb-cc88baa75a8b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.694993] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f714d433-51d2-4572-a6eb-cc88baa75a8b [ 614.695517] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.695517] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 614.695517] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 614.695859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 614.695859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 614.695859] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f714d433-51d2-4572-a6eb-cc88baa75a8b already deleted. [ 614.695859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f714d433-51d2-4572-a6eb-cc88baa75a8b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 615.004353] env[61817]: INFO networking_nsxv3.common.synchronization [None req-f817ece8-e596-42bf-bb90-10dbf749c523 None None] Enqueued Resource ID: 9daa387e-0e8e-4a49-8b7d-b0783b0a237e with Priority: HIGHEST for action port [ 615.004611] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9daa387e-0e8e-4a49-8b7d-b0783b0a237e with Priority: HIGHEST for action port [ 615.005166] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.005289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 615.005352] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 615.005542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 615.005631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 615.005787] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-9daa387e-0e8e-4a49-8b7d-b0783b0a237e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.005884] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9daa387e-0e8e-4a49-8b7d-b0783b0a237e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 615.005947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9daa387e-0e8e-4a49-8b7d-b0783b0a237e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 615.006131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9daa387e-0e8e-4a49-8b7d-b0783b0a237e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 615.006210] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9daa387e-0e8e-4a49-8b7d-b0783b0a237e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.039034] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9daa387e-0e8e-4a49-8b7d-b0783b0a237e [ 615.039243] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.039384] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 615.039499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 615.039645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 615.039732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 615.039834] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9daa387e-0e8e-4a49-8b7d-b0783b0a237e already deleted. [ 615.039897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9daa387e-0e8e-4a49-8b7d-b0783b0a237e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 615.061135] env[61817]: INFO networking_nsxv3.common.synchronization [None req-0e335360-e179-4ee2-ad60-28f2b044caaa None None] Enqueued Resource ID: fc269c63-f59c-4442-9530-47093c346ad0 with Priority: HIGHEST for action port [ 615.061382] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc269c63-f59c-4442-9530-47093c346ad0 with Priority: HIGHEST for action port [ 615.061965] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.062088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 615.062151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 615.062340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 615.062422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 615.062556] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc269c63-f59c-4442-9530-47093c346ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.062653] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc269c63-f59c-4442-9530-47093c346ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 615.062705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc269c63-f59c-4442-9530-47093c346ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 615.062912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc269c63-f59c-4442-9530-47093c346ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 615.062979] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc269c63-f59c-4442-9530-47093c346ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.109319] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc269c63-f59c-4442-9530-47093c346ad0 [ 615.109525] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.109652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 615.109716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 615.109934] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 615.110021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 615.110108] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc269c63-f59c-4442-9530-47093c346ad0 already deleted. [ 615.110183] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc269c63-f59c-4442-9530-47093c346ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 617.171494] env[61817]: INFO networking_nsxv3.common.synchronization [req-cbd4e935-5870-4f39-8c42-b8190df39b27 req-1709a692-3576-48b7-80be-7bb140e0afb8 tempest-SecurityGroupRulesTestJSON-1788170182 tempest-SecurityGroupRulesTestJSON-1788170182-project-member] Enqueued Resource ID: 90fa28b5-2374-4ac3-ad08-34690e047af1 with Priority: HIGHEST for action security_group_rules [ 617.172059] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fa28b5-2374-4ac3-ad08-34690e047af1 with Priority: HIGHEST for action security_group_rules [ 617.172349] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.172496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 617.172562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 617.172716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 617.172790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 617.172972] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90fa28b5-2374-4ac3-ad08-34690e047af1 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.173081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90fa28b5-2374-4ac3-ad08-34690e047af1" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 617.173121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90fa28b5-2374-4ac3-ad08-34690e047af1" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 617.173320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90fa28b5-2374-4ac3-ad08-34690e047af1" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 617.173405] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90fa28b5-2374-4ac3-ad08-34690e047af1',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.311936] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.312118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 617.312187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 617.312397] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 617.312485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 617.312579] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90fa28b5-2374-4ac3-ad08-34690e047af1 already deleted. [ 617.312663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90fa28b5-2374-4ac3-ad08-34690e047af1" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.577750] env[61817]: INFO networking_nsxv3.common.synchronization [None req-ec8418c1-f425-4b06-90cf-787647badb1d None None] Enqueued Resource ID: 729ed368-1262-4053-adca-7c6624e8ca1a with Priority: HIGHEST for action port [ 619.578040] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 729ed368-1262-4053-adca-7c6624e8ca1a with Priority: HIGHEST for action port [ 619.578816] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.579011] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.579011] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.579356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.579356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.579508] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-729ed368-1262-4053-adca-7c6624e8ca1a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.579585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-729ed368-1262-4053-adca-7c6624e8ca1a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.579585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-729ed368-1262-4053-adca-7c6624e8ca1a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.579766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-729ed368-1262-4053-adca-7c6624e8ca1a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.579842] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('729ed368-1262-4053-adca-7c6624e8ca1a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.617022] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 729ed368-1262-4053-adca-7c6624e8ca1a [ 619.617226] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.617356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.617428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.617625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.617713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.617801] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:729ed368-1262-4053-adca-7c6624e8ca1a already deleted. [ 619.617878] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-729ed368-1262-4053-adca-7c6624e8ca1a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.713357] env[61817]: INFO networking_nsxv3.common.synchronization [None req-407ad336-907c-4cc0-84b1-e0467c53fa97 None None] Enqueued Resource ID: bdf05908-1425-4f3f-b462-a89104cad21f with Priority: HIGHEST for action port [ 619.713887] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf05908-1425-4f3f-b462-a89104cad21f with Priority: HIGHEST for action port [ 619.714181] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.714296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.714359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.714560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.714640] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.714789] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdf05908-1425-4f3f-b462-a89104cad21f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.714880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdf05908-1425-4f3f-b462-a89104cad21f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.714938] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdf05908-1425-4f3f-b462-a89104cad21f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.715124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdf05908-1425-4f3f-b462-a89104cad21f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.715200] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf05908-1425-4f3f-b462-a89104cad21f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.756194] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdf05908-1425-4f3f-b462-a89104cad21f [ 619.756517] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.756623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 619.756623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 619.756896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 619.756977] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 619.757020] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdf05908-1425-4f3f-b462-a89104cad21f already deleted. [ 619.757069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdf05908-1425-4f3f-b462-a89104cad21f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.344490] env[61817]: INFO networking_nsxv3.common.synchronization [None req-453c642c-9d68-4eb0-985d-4b0ede5da4d1 None None] Enqueued Resource ID: edf23080-8b4c-4214-9a78-70e5d72c871a with Priority: HIGHEST for action port [ 621.344772] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edf23080-8b4c-4214-9a78-70e5d72c871a with Priority: HIGHEST for action port [ 621.345357] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.345497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 621.345565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.345763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.345842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.345995] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-edf23080-8b4c-4214-9a78-70e5d72c871a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.346083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edf23080-8b4c-4214-9a78-70e5d72c871a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 621.346140] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edf23080-8b4c-4214-9a78-70e5d72c871a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.346334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edf23080-8b4c-4214-9a78-70e5d72c871a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.346410] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edf23080-8b4c-4214-9a78-70e5d72c871a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.360875] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port edf23080-8b4c-4214-9a78-70e5d72c871a [ 621.361085] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.361210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 621.361274] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.361496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.361594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.361668] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:edf23080-8b4c-4214-9a78-70e5d72c871a already deleted. [ 621.361743] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edf23080-8b4c-4214-9a78-70e5d72c871a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.434491] env[61817]: INFO networking_nsxv3.common.synchronization [None req-6db70d4c-7618-468c-98aa-dd75ecb4b02f None None] Enqueued Resource ID: 18aa357f-5065-4dfd-b012-193b4d932b0e with Priority: HIGHEST for action port [ 621.435114] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18aa357f-5065-4dfd-b012-193b4d932b0e with Priority: HIGHEST for action port [ 621.435550] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.435550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 621.435645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.435797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.435874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.436036] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-18aa357f-5065-4dfd-b012-193b4d932b0e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.436151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18aa357f-5065-4dfd-b012-193b4d932b0e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 621.436216] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18aa357f-5065-4dfd-b012-193b4d932b0e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.436480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18aa357f-5065-4dfd-b012-193b4d932b0e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.436480] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18aa357f-5065-4dfd-b012-193b4d932b0e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.457131] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18aa357f-5065-4dfd-b012-193b4d932b0e [ 621.457351] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.457489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 621.457555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 621.457758] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 621.457841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 621.457931] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18aa357f-5065-4dfd-b012-193b4d932b0e already deleted. [ 621.458018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18aa357f-5065-4dfd-b012-193b4d932b0e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 622.693381] env[61817]: INFO networking_nsxv3.common.synchronization [req-130466c9-90d1-4ca1-955b-9d5ed725afec req-dcbd47a4-c1b9-48b6-85e3-713812160c7f tempest-SecurityGroupRulesTestJSON-1788170182 tempest-SecurityGroupRulesTestJSON-1788170182-project-member] Enqueued Resource ID: 82cf32b0-984e-4d46-ae26-2a8f0c696730 with Priority: HIGHEST for action security_group_rules [ 622.693896] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82cf32b0-984e-4d46-ae26-2a8f0c696730 with Priority: HIGHEST for action security_group_rules [ 622.694258] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.694362] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 622.694398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 622.694569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 622.694647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 622.694790] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82cf32b0-984e-4d46-ae26-2a8f0c696730 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.694886] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82cf32b0-984e-4d46-ae26-2a8f0c696730" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 622.694962] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82cf32b0-984e-4d46-ae26-2a8f0c696730" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 622.695163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82cf32b0-984e-4d46-ae26-2a8f0c696730" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 622.700467] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82cf32b0-984e-4d46-ae26-2a8f0c696730',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.778091] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.778276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 622.778335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 622.778516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 622.778632] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 622.778728] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82cf32b0-984e-4d46-ae26-2a8f0c696730 already deleted. [ 622.778806] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82cf32b0-984e-4d46-ae26-2a8f0c696730" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 622.807348] env[61817]: INFO networking_nsxv3.common.synchronization [None req-e56d9992-bb6c-4185-8281-267efe6d0d0e tempest-VolumesAdminNegativeTest-1661419758 tempest-VolumesAdminNegativeTest-1661419758-project-member] Enqueued Resource ID: a20a059f-655e-42f9-aea3-70364f61f1e6 with Priority: HIGHEST for action security_group_rules [ 622.807872] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a20a059f-655e-42f9-aea3-70364f61f1e6 with Priority: HIGHEST for action security_group_rules [ 622.808764] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.809346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 622.809635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 622.810108] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 622.810629] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 622.811066] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a20a059f-655e-42f9-aea3-70364f61f1e6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.811795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a20a059f-655e-42f9-aea3-70364f61f1e6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 622.811795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a20a059f-655e-42f9-aea3-70364f61f1e6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 622.812670] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a20a059f-655e-42f9-aea3-70364f61f1e6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 622.812815] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a20a059f-655e-42f9-aea3-70364f61f1e6',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.892690] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.892918] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 622.893019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 622.893274] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 622.893416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 622.893556] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a20a059f-655e-42f9-aea3-70364f61f1e6 already deleted. [ 622.893668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a20a059f-655e-42f9-aea3-70364f61f1e6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 623.212905] env[61817]: INFO networking_nsxv3.common.synchronization [None req-1206d629-8ccb-4a20-827e-6fa5b490b002 None None] Enqueued Resource ID: c51f0fa7-cef5-4449-9db0-824222c076bd with Priority: HIGHEST for action port [ 623.213661] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c51f0fa7-cef5-4449-9db0-824222c076bd with Priority: HIGHEST for action port [ 623.213835] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.213835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 623.213926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 623.214104] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 623.214185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 623.214337] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-c51f0fa7-cef5-4449-9db0-824222c076bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.214427] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c51f0fa7-cef5-4449-9db0-824222c076bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 623.214495] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c51f0fa7-cef5-4449-9db0-824222c076bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 623.214696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c51f0fa7-cef5-4449-9db0-824222c076bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 623.214954] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c51f0fa7-cef5-4449-9db0-824222c076bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.242364] env[61817]: INFO networking_nsxv3.common.synchronization [None req-898d1f6f-3312-41d6-93c1-b8963680ab91 tempest-VolumesAdminNegativeTest-1661419758 tempest-VolumesAdminNegativeTest-1661419758-project-member] Enqueued Resource ID: a20a059f-655e-42f9-aea3-70364f61f1e6 with Priority: HIGHEST for action security_group_rules [ 623.242919] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a20a059f-655e-42f9-aea3-70364f61f1e6 with Priority: HIGHEST for action security_group_rules [ 623.243155] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.243369] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 623.243369] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 623.243544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 623.243645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 623.243802] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a20a059f-655e-42f9-aea3-70364f61f1e6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.243896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a20a059f-655e-42f9-aea3-70364f61f1e6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 623.243960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a20a059f-655e-42f9-aea3-70364f61f1e6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 623.244132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a20a059f-655e-42f9-aea3-70364f61f1e6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 623.244205] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a20a059f-655e-42f9-aea3-70364f61f1e6',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.259339] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c51f0fa7-cef5-4449-9db0-824222c076bd [ 623.259557] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.259692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 623.259767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 623.259963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 623.260079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 623.260171] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c51f0fa7-cef5-4449-9db0-824222c076bd already deleted. [ 623.260254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c51f0fa7-cef5-4449-9db0-824222c076bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 623.339378] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.339378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 623.339378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 623.339378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 623.339378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 623.339378] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a20a059f-655e-42f9-aea3-70364f61f1e6 already deleted. [ 623.339378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a20a059f-655e-42f9-aea3-70364f61f1e6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 623.758219] env[61817]: INFO networking_nsxv3.common.synchronization [None req-3832a891-508c-4933-8852-2466216bbfaa None None] Enqueued Resource ID: a326a914-6367-451b-99ec-bbe4d6e560de with Priority: HIGHEST for action port [ 623.758503] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a326a914-6367-451b-99ec-bbe4d6e560de with Priority: HIGHEST for action port [ 623.759087] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.759218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 623.759290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 623.759521] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 623.759611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 623.759762] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-a326a914-6367-451b-99ec-bbe4d6e560de taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.759856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a326a914-6367-451b-99ec-bbe4d6e560de" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 623.759915] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a326a914-6367-451b-99ec-bbe4d6e560de" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 623.760194] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a326a914-6367-451b-99ec-bbe4d6e560de" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 623.760311] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a326a914-6367-451b-99ec-bbe4d6e560de',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.789059] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a326a914-6367-451b-99ec-bbe4d6e560de [ 623.789280] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.790213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 623.790213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 623.790213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 623.790213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 623.790213] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a326a914-6367-451b-99ec-bbe4d6e560de already deleted. [ 623.790213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a326a914-6367-451b-99ec-bbe4d6e560de" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 624.562035] env[61817]: INFO networking_nsxv3.common.synchronization [None req-5945cc53-15ee-4f1e-8851-5c90df844350 None None] Enqueued Resource ID: b4e83a16-d339-4183-8637-f84e3ee14039 with Priority: HIGHEST for action port [ 624.562035] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4e83a16-d339-4183-8637-f84e3ee14039 with Priority: HIGHEST for action port [ 624.562035] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.562035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 624.562035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 624.562035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 624.562035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 624.562035] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4e83a16-d339-4183-8637-f84e3ee14039 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.562035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4e83a16-d339-4183-8637-f84e3ee14039" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 624.562035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4e83a16-d339-4183-8637-f84e3ee14039" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 624.562035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4e83a16-d339-4183-8637-f84e3ee14039" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 624.562035] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4e83a16-d339-4183-8637-f84e3ee14039',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.584974] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4e83a16-d339-4183-8637-f84e3ee14039 [ 624.584974] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.584974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 624.584974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 624.584974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 624.584974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 624.584974] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4e83a16-d339-4183-8637-f84e3ee14039 already deleted. [ 624.584974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4e83a16-d339-4183-8637-f84e3ee14039" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 625.474662] env[61817]: INFO networking_nsxv3.common.synchronization [None req-1746b118-a3f9-4780-a54d-ff27d058db9f None None] Enqueued Resource ID: 993d9dd0-f542-478e-9c54-eda6eed69404 with Priority: HIGHEST for action port [ 625.474994] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993d9dd0-f542-478e-9c54-eda6eed69404 with Priority: HIGHEST for action port [ 625.475456] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.475585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 625.475654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 625.475852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 625.475936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 625.476105] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-993d9dd0-f542-478e-9c54-eda6eed69404 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.476198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-993d9dd0-f542-478e-9c54-eda6eed69404" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 625.476258] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-993d9dd0-f542-478e-9c54-eda6eed69404" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 625.476455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-993d9dd0-f542-478e-9c54-eda6eed69404" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 625.476547] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('993d9dd0-f542-478e-9c54-eda6eed69404',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.508307] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 993d9dd0-f542-478e-9c54-eda6eed69404 [ 625.508423] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.508569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 625.508640] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 625.508828] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 625.508916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 625.509022] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:993d9dd0-f542-478e-9c54-eda6eed69404 already deleted. [ 625.509072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-993d9dd0-f542-478e-9c54-eda6eed69404" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 626.063505] env[61817]: INFO networking_nsxv3.common.synchronization [req-fb278452-311c-4263-b306-163cc44ee598 req-d5b338ae-2291-49cc-8b77-a15b96e48ff1 tempest-SecurityGroupRulesTestJSON-1788170182 tempest-SecurityGroupRulesTestJSON-1788170182-project-member] Enqueued Resource ID: 4e9c97bb-698b-4790-88f6-f3463c13df6c with Priority: HIGHEST for action security_group_rules [ 626.064043] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9c97bb-698b-4790-88f6-f3463c13df6c with Priority: HIGHEST for action security_group_rules [ 626.064350] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.064477] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 626.064545] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 626.064734] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 626.064811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 626.064957] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e9c97bb-698b-4790-88f6-f3463c13df6c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.065040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e9c97bb-698b-4790-88f6-f3463c13df6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 626.065099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e9c97bb-698b-4790-88f6-f3463c13df6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 626.065278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e9c97bb-698b-4790-88f6-f3463c13df6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 626.065352] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e9c97bb-698b-4790-88f6-f3463c13df6c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.106765] env[61817]: INFO networking_nsxv3.common.synchronization [None req-082624d4-cf1a-4233-b408-9d1d97340f54 None None] Enqueued Resource ID: e5bd0aa8-2ffb-46f9-8360-907cd0fcaf09 with Priority: HIGHEST for action port [ 626.107032] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5bd0aa8-2ffb-46f9-8360-907cd0fcaf09 with Priority: HIGHEST for action port [ 626.108378] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.108378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 626.108378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 626.108378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 626.108378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 626.108378] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5bd0aa8-2ffb-46f9-8360-907cd0fcaf09 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.108378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5bd0aa8-2ffb-46f9-8360-907cd0fcaf09" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 626.108378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5bd0aa8-2ffb-46f9-8360-907cd0fcaf09" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 626.108988] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5bd0aa8-2ffb-46f9-8360-907cd0fcaf09" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 626.108988] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5bd0aa8-2ffb-46f9-8360-907cd0fcaf09',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.115335] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.115503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 626.115557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 626.115725] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 626.115812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 626.115898] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e9c97bb-698b-4790-88f6-f3463c13df6c already deleted. [ 626.115984] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e9c97bb-698b-4790-88f6-f3463c13df6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 626.127379] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5bd0aa8-2ffb-46f9-8360-907cd0fcaf09 [ 626.127593] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.127726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 626.127780] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 626.127978] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 626.128098] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 626.128187] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5bd0aa8-2ffb-46f9-8360-907cd0fcaf09 already deleted. [ 626.128305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5bd0aa8-2ffb-46f9-8360-907cd0fcaf09" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.066412] env[61817]: INFO networking_nsxv3.common.synchronization [None req-4e68f965-40d6-4939-9d16-355af5123a0b None None] Enqueued Resource ID: efe4895b-b8f3-4422-91e8-c277db398ce6 with Priority: HIGHEST for action port [ 628.066412] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efe4895b-b8f3-4422-91e8-c277db398ce6 with Priority: HIGHEST for action port [ 628.066412] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.066412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.066412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.066412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.066412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.066412] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-efe4895b-b8f3-4422-91e8-c277db398ce6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.066412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efe4895b-b8f3-4422-91e8-c277db398ce6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.066412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efe4895b-b8f3-4422-91e8-c277db398ce6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.066412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efe4895b-b8f3-4422-91e8-c277db398ce6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.066412] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efe4895b-b8f3-4422-91e8-c277db398ce6',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.088443] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port efe4895b-b8f3-4422-91e8-c277db398ce6 [ 628.088443] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.088443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.088443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.088443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.088443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.088443] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:efe4895b-b8f3-4422-91e8-c277db398ce6 already deleted. [ 628.088443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efe4895b-b8f3-4422-91e8-c277db398ce6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.097011] env[61817]: INFO networking_nsxv3.common.synchronization [None req-183c03b2-fdf2-45fc-86c4-0b05d99d0f49 None None] Enqueued Resource ID: 665e2b32-f9f7-4160-a649-713bd3e9c93e with Priority: HIGHEST for action port [ 628.097625] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 665e2b32-f9f7-4160-a649-713bd3e9c93e with Priority: HIGHEST for action port [ 628.097857] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.097975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.098039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.098239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.098321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.098473] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-665e2b32-f9f7-4160-a649-713bd3e9c93e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.098600] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-665e2b32-f9f7-4160-a649-713bd3e9c93e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.098663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-665e2b32-f9f7-4160-a649-713bd3e9c93e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.098861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-665e2b32-f9f7-4160-a649-713bd3e9c93e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.098938] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('665e2b32-f9f7-4160-a649-713bd3e9c93e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.111173] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 665e2b32-f9f7-4160-a649-713bd3e9c93e [ 628.111399] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.111500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.111563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.111764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.111858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.111934] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:665e2b32-f9f7-4160-a649-713bd3e9c93e already deleted. [ 628.112018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-665e2b32-f9f7-4160-a649-713bd3e9c93e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.424288] env[61817]: INFO networking_nsxv3.common.synchronization [None req-5553f080-9dd5-4254-9be1-8b2f22fbb267 tempest-ServersTestFqdnHostnames-466634136 tempest-ServersTestFqdnHostnames-466634136-project-member] Enqueued Resource ID: a4fbb381-6771-4c67-bdc0-3d94e5035142 with Priority: HIGHEST for action security_group_rules [ 628.424819] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4fbb381-6771-4c67-bdc0-3d94e5035142 with Priority: HIGHEST for action security_group_rules [ 628.425127] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.425265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.425334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.425518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.425626] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.425729] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4fbb381-6771-4c67-bdc0-3d94e5035142 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.425871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4fbb381-6771-4c67-bdc0-3d94e5035142" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.425871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4fbb381-6771-4c67-bdc0-3d94e5035142" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.426068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4fbb381-6771-4c67-bdc0-3d94e5035142" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.426143] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4fbb381-6771-4c67-bdc0-3d94e5035142',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.460800] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.460958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.461029] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.461234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.461326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.461419] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4fbb381-6771-4c67-bdc0-3d94e5035142 already deleted. [ 628.461517] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4fbb381-6771-4c67-bdc0-3d94e5035142" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.538169] env[61817]: INFO networking_nsxv3.common.synchronization [None req-36c96814-f080-435f-946b-8bcacbda1c34 tempest-ServersTestFqdnHostnames-466634136 tempest-ServersTestFqdnHostnames-466634136-project-member] Enqueued Resource ID: a4fbb381-6771-4c67-bdc0-3d94e5035142 with Priority: HIGHEST for action security_group_rules [ 628.538702] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4fbb381-6771-4c67-bdc0-3d94e5035142 with Priority: HIGHEST for action security_group_rules [ 628.538997] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.539116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.539179] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.539371] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.539447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.539586] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4fbb381-6771-4c67-bdc0-3d94e5035142 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.539673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4fbb381-6771-4c67-bdc0-3d94e5035142" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.539730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4fbb381-6771-4c67-bdc0-3d94e5035142" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.539863] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4fbb381-6771-4c67-bdc0-3d94e5035142" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.539966] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4fbb381-6771-4c67-bdc0-3d94e5035142',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.579304] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.579512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 628.579512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 628.579706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 628.579793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 628.579883] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4fbb381-6771-4c67-bdc0-3d94e5035142 already deleted. [ 628.579959] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4fbb381-6771-4c67-bdc0-3d94e5035142" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 629.957805] env[61817]: INFO networking_nsxv3.common.synchronization [None req-5c4361b6-4fba-4d54-b9f4-2728656a3482 None None] Enqueued Resource ID: dd415b64-14d4-49b6-9fc2-5dfa35fbf123 with Priority: HIGHEST for action port [ 629.958124] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd415b64-14d4-49b6-9fc2-5dfa35fbf123 with Priority: HIGHEST for action port [ 629.958679] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.958810] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 629.958899] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 629.959154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 629.959207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 629.959383] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd415b64-14d4-49b6-9fc2-5dfa35fbf123 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.959484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd415b64-14d4-49b6-9fc2-5dfa35fbf123" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 629.959559] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd415b64-14d4-49b6-9fc2-5dfa35fbf123" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 629.959774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd415b64-14d4-49b6-9fc2-5dfa35fbf123" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 629.959854] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd415b64-14d4-49b6-9fc2-5dfa35fbf123',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.992919] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd415b64-14d4-49b6-9fc2-5dfa35fbf123 [ 629.992919] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.993165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 629.993165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 629.993231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 629.993349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 629.993397] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd415b64-14d4-49b6-9fc2-5dfa35fbf123 already deleted. [ 629.993469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd415b64-14d4-49b6-9fc2-5dfa35fbf123" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 631.085149] env[61817]: INFO networking_nsxv3.common.synchronization [None req-b20748b0-9817-43b3-b628-68e0e4b419e3 None None] Enqueued Resource ID: 46b91d92-b1a1-42fb-bc49-6e5adf819623 with Priority: HIGHEST for action port [ 631.085149] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46b91d92-b1a1-42fb-bc49-6e5adf819623 with Priority: HIGHEST for action port [ 631.085149] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.085149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 631.085149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 631.085149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 631.085149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 631.085149] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-46b91d92-b1a1-42fb-bc49-6e5adf819623 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.085149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46b91d92-b1a1-42fb-bc49-6e5adf819623" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 631.085149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46b91d92-b1a1-42fb-bc49-6e5adf819623" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 631.085149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46b91d92-b1a1-42fb-bc49-6e5adf819623" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 631.085149] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46b91d92-b1a1-42fb-bc49-6e5adf819623',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.126021] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46b91d92-b1a1-42fb-bc49-6e5adf819623 [ 631.126021] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.127731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 631.127731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 631.127731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 631.127731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 631.127731] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46b91d92-b1a1-42fb-bc49-6e5adf819623 already deleted. [ 631.127731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46b91d92-b1a1-42fb-bc49-6e5adf819623" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 632.303770] env[61817]: INFO networking_nsxv3.common.synchronization [None req-a15af699-adab-4ded-a080-25dd0261c73c None None] Enqueued Resource ID: 2e78a315-1f89-458a-a772-87742ed34038 with Priority: HIGHEST for action port [ 632.303770] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e78a315-1f89-458a-a772-87742ed34038 with Priority: HIGHEST for action port [ 632.303770] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.303770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 632.303770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 632.303770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 632.303770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 632.303770] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e78a315-1f89-458a-a772-87742ed34038 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.303770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e78a315-1f89-458a-a772-87742ed34038" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 632.303770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e78a315-1f89-458a-a772-87742ed34038" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 632.303770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e78a315-1f89-458a-a772-87742ed34038" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 632.303770] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e78a315-1f89-458a-a772-87742ed34038',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.467233] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e78a315-1f89-458a-a772-87742ed34038 [ 632.467233] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.467233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 632.467233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 632.467233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 632.467233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 632.467233] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e78a315-1f89-458a-a772-87742ed34038 already deleted. [ 632.467233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e78a315-1f89-458a-a772-87742ed34038" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 632.759872] env[61817]: INFO networking_nsxv3.common.synchronization [None req-28175111-13e4-44c7-b20a-21f7754fd01c None None] Enqueued Resource ID: 8cac2bcf-faa4-4b83-8fe1-c5371f3a79a0 with Priority: HIGHEST for action port [ 632.759872] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cac2bcf-faa4-4b83-8fe1-c5371f3a79a0 with Priority: HIGHEST for action port [ 632.759872] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.759872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 632.759872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 632.759872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 632.759872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 632.759872] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cac2bcf-faa4-4b83-8fe1-c5371f3a79a0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.759872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cac2bcf-faa4-4b83-8fe1-c5371f3a79a0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 632.759872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cac2bcf-faa4-4b83-8fe1-c5371f3a79a0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 632.759872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cac2bcf-faa4-4b83-8fe1-c5371f3a79a0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 632.759872] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cac2bcf-faa4-4b83-8fe1-c5371f3a79a0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.770588] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cac2bcf-faa4-4b83-8fe1-c5371f3a79a0 [ 632.771302] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.771587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 632.771921] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 632.772680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 632.772949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 632.773154] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cac2bcf-faa4-4b83-8fe1-c5371f3a79a0 already deleted. [ 632.773335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cac2bcf-faa4-4b83-8fe1-c5371f3a79a0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 632.951417] env[61817]: INFO networking_nsxv3.common.synchronization [req-dc954c78-f84a-4469-9d2c-5d0d6d16948d req-a781e504-9535-431b-b20b-05687af4accc tempest-SecurityGroupRulesTestJSON-1788170182 tempest-SecurityGroupRulesTestJSON-1788170182-project-member] Enqueued Resource ID: 4b091907-2942-473d-aca8-ff7e797084b2 with Priority: HIGHEST for action security_group_rules [ 632.952248] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b091907-2942-473d-aca8-ff7e797084b2 with Priority: HIGHEST for action security_group_rules [ 632.952732] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.953011] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 632.953193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 632.953530] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 632.953752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 632.954032] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b091907-2942-473d-aca8-ff7e797084b2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.954268] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b091907-2942-473d-aca8-ff7e797084b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 632.954455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b091907-2942-473d-aca8-ff7e797084b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 632.954761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b091907-2942-473d-aca8-ff7e797084b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 632.954969] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b091907-2942-473d-aca8-ff7e797084b2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.986483] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.987278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 632.987474] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 632.987794] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 632.988133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 632.988430] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b091907-2942-473d-aca8-ff7e797084b2 already deleted. [ 632.988610] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b091907-2942-473d-aca8-ff7e797084b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 633.897405] env[61817]: INFO networking_nsxv3.common.synchronization [None req-0528ff32-0318-4b81-987c-8b1956cdc6e2 tempest-AttachVolumeNegativeTest-329748670 tempest-AttachVolumeNegativeTest-329748670-project-member] Enqueued Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGHEST for action security_group_rules [ 633.897929] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGHEST for action security_group_rules [ 633.898298] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.898452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 633.898503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 633.898684] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 633.898763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 633.898915] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.899004] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 633.899357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 633.899357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 633.899357] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.003961] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.004181] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 634.004181] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 634.004456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 634.004507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 634.004576] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d193cbd-452d-400d-b88e-58fc27978848 already deleted. [ 634.004664] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 634.126873] env[61817]: INFO networking_nsxv3.common.synchronization [None req-653cc98b-907f-47ac-a92f-cac8d3f3af70 None None] Enqueued Resource ID: 6200d1ca-e236-4ed2-9f4d-5bb6155ebddc with Priority: HIGHEST for action port [ 634.127124] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6200d1ca-e236-4ed2-9f4d-5bb6155ebddc with Priority: HIGHEST for action port [ 634.127670] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.127797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 634.127864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 634.128087] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 634.128172] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 634.128316] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-6200d1ca-e236-4ed2-9f4d-5bb6155ebddc taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.128412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6200d1ca-e236-4ed2-9f4d-5bb6155ebddc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 634.128464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6200d1ca-e236-4ed2-9f4d-5bb6155ebddc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 634.128654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6200d1ca-e236-4ed2-9f4d-5bb6155ebddc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 634.128736] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6200d1ca-e236-4ed2-9f4d-5bb6155ebddc',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.140971] env[61817]: INFO networking_nsxv3.common.synchronization [None req-b1dcc58e-3a86-4bca-a4e6-8c54bfe72c48 tempest-AttachVolumeNegativeTest-329748670 tempest-AttachVolumeNegativeTest-329748670-project-member] Enqueued Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGHEST for action security_group_rules [ 634.141084] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGHEST for action security_group_rules [ 634.141310] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.141435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 634.141504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 634.141728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 634.141809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 634.141967] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.142045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 634.142107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 634.142260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 634.142336] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.160554] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6200d1ca-e236-4ed2-9f4d-5bb6155ebddc [ 634.160797] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.160926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 634.160995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 634.161192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 634.161282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 634.161369] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6200d1ca-e236-4ed2-9f4d-5bb6155ebddc already deleted. [ 634.161448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6200d1ca-e236-4ed2-9f4d-5bb6155ebddc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 634.185330] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.185472] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 634.185541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 634.185765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 634.185860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 634.185956] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d193cbd-452d-400d-b88e-58fc27978848 already deleted. [ 634.186025] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 634.811186] env[61817]: INFO networking_nsxv3.common.synchronization [req-39381ba6-acc1-4f7e-8132-2d29d72856d2 req-01963dcb-8f8c-4773-9108-1671a2ceef64 tempest-SecurityGroupRulesTestJSON-1788170182 tempest-SecurityGroupRulesTestJSON-1788170182-project-member] Enqueued Resource ID: 4b091907-2942-473d-aca8-ff7e797084b2 with Priority: HIGHEST for action security_group_rules [ 634.811678] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b091907-2942-473d-aca8-ff7e797084b2 with Priority: HIGHEST for action security_group_rules [ 634.811899] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.812107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 634.812107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 634.812297] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 634.812385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 634.812535] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b091907-2942-473d-aca8-ff7e797084b2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.812634] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b091907-2942-473d-aca8-ff7e797084b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 634.812696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b091907-2942-473d-aca8-ff7e797084b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 634.812870] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b091907-2942-473d-aca8-ff7e797084b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 634.812953] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b091907-2942-473d-aca8-ff7e797084b2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.843204] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.843364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 634.843436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 634.843645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 634.843738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 634.843833] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b091907-2942-473d-aca8-ff7e797084b2 already deleted. [ 634.843913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b091907-2942-473d-aca8-ff7e797084b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 635.629870] env[61817]: INFO networking_nsxv3.common.synchronization [None req-1660bdfd-62e4-4f52-acb0-fa29406d78b9 None None] Enqueued Resource ID: 9ebeacb8-9896-4a20-9cdb-89ef33c9f092 with Priority: HIGHEST for action port [ 635.630419] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ebeacb8-9896-4a20-9cdb-89ef33c9f092 with Priority: HIGHEST for action port [ 635.630844] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.630936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 635.630936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 635.631134] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 635.631211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 635.631362] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ebeacb8-9896-4a20-9cdb-89ef33c9f092 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.631453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ebeacb8-9896-4a20-9cdb-89ef33c9f092" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 635.631516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ebeacb8-9896-4a20-9cdb-89ef33c9f092" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 635.631714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ebeacb8-9896-4a20-9cdb-89ef33c9f092" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 635.631790] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ebeacb8-9896-4a20-9cdb-89ef33c9f092',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.648745] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ebeacb8-9896-4a20-9cdb-89ef33c9f092 [ 635.648980] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.649134] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 635.649200] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 635.649456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 635.649588] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 635.649687] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ebeacb8-9896-4a20-9cdb-89ef33c9f092 already deleted. [ 635.649782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ebeacb8-9896-4a20-9cdb-89ef33c9f092" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 635.677608] env[61817]: INFO networking_nsxv3.common.synchronization [None req-0ea8c8af-0f09-4b28-a960-347974343ced None None] Enqueued Resource ID: f98b9edd-8ec9-4b8e-ad77-9c19f02d956b with Priority: HIGHEST for action port [ 635.677870] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f98b9edd-8ec9-4b8e-ad77-9c19f02d956b with Priority: HIGHEST for action port [ 635.678471] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.678612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 635.678678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 635.678877] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 635.678956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 635.679115] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f98b9edd-8ec9-4b8e-ad77-9c19f02d956b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.679206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f98b9edd-8ec9-4b8e-ad77-9c19f02d956b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 635.679258] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f98b9edd-8ec9-4b8e-ad77-9c19f02d956b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 635.679441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f98b9edd-8ec9-4b8e-ad77-9c19f02d956b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 635.679517] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f98b9edd-8ec9-4b8e-ad77-9c19f02d956b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.696611] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f98b9edd-8ec9-4b8e-ad77-9c19f02d956b [ 635.696904] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.697066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 635.697178] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 635.697456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 635.697564] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 635.697656] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f98b9edd-8ec9-4b8e-ad77-9c19f02d956b already deleted. [ 635.697734] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f98b9edd-8ec9-4b8e-ad77-9c19f02d956b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 636.013591] env[61817]: INFO networking_nsxv3.common.synchronization [None req-8c0315c8-37d0-4f88-8bcc-21f96d23d846 None None] Enqueued Resource ID: 1cf582f0-2b07-4ebe-86f6-80676eae1062 with Priority: HIGHEST for action port [ 636.013843] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf582f0-2b07-4ebe-86f6-80676eae1062 with Priority: HIGHEST for action port [ 636.014499] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.014627] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 636.014694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 636.014890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 636.014974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 636.015120] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cf582f0-2b07-4ebe-86f6-80676eae1062 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.015205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cf582f0-2b07-4ebe-86f6-80676eae1062" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 636.015329] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cf582f0-2b07-4ebe-86f6-80676eae1062" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 636.015443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cf582f0-2b07-4ebe-86f6-80676eae1062" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 636.015517] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cf582f0-2b07-4ebe-86f6-80676eae1062',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.034815] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1cf582f0-2b07-4ebe-86f6-80676eae1062 [ 636.035033] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.035161] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 636.035221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 636.035420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 636.035527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 636.035628] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1cf582f0-2b07-4ebe-86f6-80676eae1062 already deleted. [ 636.035746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cf582f0-2b07-4ebe-86f6-80676eae1062" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 637.438241] env[61817]: INFO networking_nsxv3.common.synchronization [req-f4ed8a48-ef58-41de-9d8a-fa91a494fcb8 req-cbbcde1c-d483-4178-a3af-b1fea1e4d1e7 tempest-SecurityGroupRulesTestJSON-1788170182 tempest-SecurityGroupRulesTestJSON-1788170182-project-member] Enqueued Resource ID: 4b091907-2942-473d-aca8-ff7e797084b2 with Priority: HIGHEST for action security_group_rules [ 637.438895] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b091907-2942-473d-aca8-ff7e797084b2 with Priority: HIGHEST for action security_group_rules [ 637.439196] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.439320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 637.439386] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 637.439589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 637.439669] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 637.439814] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b091907-2942-473d-aca8-ff7e797084b2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.439945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b091907-2942-473d-aca8-ff7e797084b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 637.439983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b091907-2942-473d-aca8-ff7e797084b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 637.440259] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b091907-2942-473d-aca8-ff7e797084b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 637.443326] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b091907-2942-473d-aca8-ff7e797084b2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.477195] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.477401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 637.477401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 637.477604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 637.477743] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 637.477808] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b091907-2942-473d-aca8-ff7e797084b2 already deleted. [ 637.477892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b091907-2942-473d-aca8-ff7e797084b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 638.730361] env[61817]: INFO networking_nsxv3.common.synchronization [None req-0fc5abb9-f9a3-4043-b7b9-dae1d17c9433 None None] Enqueued Resource ID: 3621af91-86bc-451a-8809-4c1a0565172e with Priority: HIGHEST for action port [ 638.730646] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3621af91-86bc-451a-8809-4c1a0565172e with Priority: HIGHEST for action port [ 638.731209] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.731332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 638.731405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 638.731642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 638.731736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 638.731880] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-3621af91-86bc-451a-8809-4c1a0565172e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.732048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3621af91-86bc-451a-8809-4c1a0565172e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 638.732048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3621af91-86bc-451a-8809-4c1a0565172e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 638.732265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3621af91-86bc-451a-8809-4c1a0565172e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 638.732346] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3621af91-86bc-451a-8809-4c1a0565172e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.789605] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3621af91-86bc-451a-8809-4c1a0565172e [ 638.790702] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.790702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 638.790702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 638.790702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 638.790702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 638.790702] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3621af91-86bc-451a-8809-4c1a0565172e already deleted. [ 638.790702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3621af91-86bc-451a-8809-4c1a0565172e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.141176] env[61817]: INFO networking_nsxv3.common.synchronization [req-4e159b2a-b486-46f5-adb0-f6fd9c1569a6 req-0c1595b5-499b-4816-8bf2-cf32fd115ef9 tempest-ServerDiskConfigTestJSON-1489146392 tempest-ServerDiskConfigTestJSON-1489146392-project-member] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 639.141687] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 639.141988] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.142111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.142173] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.142366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.142457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.142606] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.142807] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.142807] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.142940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.143076] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.143167] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.143229] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.143371] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.143450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.143538] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.171777] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.172066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.172136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.172312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.172419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.172632] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.172777] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.172820] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.172991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.173079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.173272] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 already deleted. [ 639.173433] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.659603] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.659807] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.659932] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.660235] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.660383] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.660667] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.660826] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.660942] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.661207] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.661451] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.661622] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.661738] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.662096] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.662096] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.662246] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.662473] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.662570] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.662687] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.662902] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.663042] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.663274] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.663453] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.663563] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.663792] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.663882] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.687186] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.687387] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.687506] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.687776] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.687918] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.688077] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 not found, creating... [ 639.688326] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.688475] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.688620] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.688867] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.689013] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.689328] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.689467] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.689598] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.689825] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.689958] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.690094] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 is going to be created. [ 639.711750] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.712019] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.712192] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.712469] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.712705] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.712925] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.958759] env[61817]: INFO networking_nsxv3.common.synchronization [req-4e159b2a-b486-46f5-adb0-f6fd9c1569a6 req-8d340c44-c08b-483e-8618-2611972c26f4 service neutron] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_rules [ 639.959077] env[61817]: INFO networking_nsxv3.common.synchronization [req-4e159b2a-b486-46f5-adb0-f6fd9c1569a6 req-8d340c44-c08b-483e-8618-2611972c26f4 service neutron] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 639.959191] env[61817]: INFO networking_nsxv3.common.synchronization [req-4e159b2a-b486-46f5-adb0-f6fd9c1569a6 req-8d340c44-c08b-483e-8618-2611972c26f4 service neutron] Enqueued Resource ID: f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 with Priority: HIGHEST for action port [ 639.959680] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_rules [ 639.959846] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 639.959977] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 with Priority: HIGHEST for action port [ 639.960306] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.962730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.962730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.962730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.962730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.962730] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.962730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.962730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.962730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.962730] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.966306] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.966474] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.966576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.966805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.966923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.967106] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.967236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.967323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.967614] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.967838] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.967988] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.968678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.968678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.968678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.968678] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.980332] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.980332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.980332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.980332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.980332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.980332] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.980332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.980332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.980332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.980332] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.996171] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.996171] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 639.996469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 639.996469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 639.996469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 639.997133] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.997133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.001864] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.018496] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 with status ACTIVE [ 640.018709] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.018976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.018976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.019103] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.019185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.019365] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.019467] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.019527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.019690] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.019782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.021682] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.038369] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.038536] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.038615] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.038821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.038951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.039002] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be created. [ 640.069209] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.069363] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.069435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.069649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.069812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.084831] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: UNINITIALIZED for 2s [ 640.471720] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.471720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.471720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.471720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.471720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.471720] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 is going to be updated. [ 640.493700] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.493978] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 640.493978] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 640.494117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 640.494255] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 640.494408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.097499] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 642.097499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.097499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.097499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.097499] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.097499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.097499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.097499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.097499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.097499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.097499] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.111064] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.111064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.111064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.111064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.111064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.111064] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.111064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.111064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.111064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.111064] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.111064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.111064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.111064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.111064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.111064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.112382] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.112382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.112382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.112382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.112382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.112382] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.112382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.112382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.112382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.112382] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.112382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.112382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.112382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.112382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.112382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.112382] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.123609] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5233168b-5f93-4bb0-bac2-dd279d965d46: rpc.has_security_group_logging(os_id): False [ 642.144575] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.145069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.145069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.145069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.145235] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.145313] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.145416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.145463] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.145669] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.145774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.146012] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.146137] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.146218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.146387] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.146468] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.146642] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.146744] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.146814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.147014] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.147107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.147196] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be created. [ 642.204688] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.204801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.204883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.205082] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.205272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.217073] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 642.238598] env[61817]: INFO networking_nsxv3.common.synchronization [None req-2874f948-1808-473a-ac49-71a1d5cace90 None None] Enqueued Resource ID: 1f38014d-777c-41c5-8869-a53509296301 with Priority: HIGHEST for action port [ 642.238938] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f38014d-777c-41c5-8869-a53509296301 with Priority: HIGHEST for action port [ 642.239733] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.239803] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.239869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.240102] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.240197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.240354] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f38014d-777c-41c5-8869-a53509296301 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.240450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f38014d-777c-41c5-8869-a53509296301" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.240562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f38014d-777c-41c5-8869-a53509296301" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.240753] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f38014d-777c-41c5-8869-a53509296301" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.240838] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f38014d-777c-41c5-8869-a53509296301',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.257000] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f38014d-777c-41c5-8869-a53509296301 [ 642.257307] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.261450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 642.261450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 642.261450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 642.261450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 642.261450] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f38014d-777c-41c5-8869-a53509296301 already deleted. [ 642.261450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f38014d-777c-41c5-8869-a53509296301" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 644.231240] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 644.231240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 644.555443] env[61817]: INFO networking_nsxv3.common.synchronization [None req-fdbd1d48-c80f-4bf1-9dba-3047f3baea75 None None] Enqueued Resource ID: f4f83339-d449-4a8c-826d-4b8b5fabdf6b with Priority: HIGHEST for action port [ 644.555443] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4f83339-d449-4a8c-826d-4b8b5fabdf6b with Priority: HIGHEST for action port [ 644.555443] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.555443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 644.555443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 644.555443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 644.555443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 644.555443] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4f83339-d449-4a8c-826d-4b8b5fabdf6b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.555443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4f83339-d449-4a8c-826d-4b8b5fabdf6b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 644.555443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4f83339-d449-4a8c-826d-4b8b5fabdf6b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 644.555443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4f83339-d449-4a8c-826d-4b8b5fabdf6b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 644.555443] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4f83339-d449-4a8c-826d-4b8b5fabdf6b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.731198] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4f83339-d449-4a8c-826d-4b8b5fabdf6b [ 644.731198] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.731198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 644.731198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 644.731459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 644.731511] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 644.731594] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4f83339-d449-4a8c-826d-4b8b5fabdf6b already deleted. [ 644.731674] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4f83339-d449-4a8c-826d-4b8b5fabdf6b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 645.875562] env[61817]: INFO networking_nsxv3.common.synchronization [None req-4deba489-0168-4c50-8ec5-89d888b5f189 None None] Enqueued Resource ID: ad742fe9-51ee-401d-937e-b45cd7721882 with Priority: HIGHEST for action port [ 645.879461] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad742fe9-51ee-401d-937e-b45cd7721882 with Priority: HIGHEST for action port [ 645.879461] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.879461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 645.879461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 645.879461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 645.879461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 645.879461] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad742fe9-51ee-401d-937e-b45cd7721882 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.879461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad742fe9-51ee-401d-937e-b45cd7721882" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 645.879461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad742fe9-51ee-401d-937e-b45cd7721882" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 645.879461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad742fe9-51ee-401d-937e-b45cd7721882" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 645.879461] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad742fe9-51ee-401d-937e-b45cd7721882',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.905869] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad742fe9-51ee-401d-937e-b45cd7721882 [ 645.906111] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.906247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 645.906316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 645.906526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 645.906618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 645.906709] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad742fe9-51ee-401d-937e-b45cd7721882 already deleted. [ 645.906789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad742fe9-51ee-401d-937e-b45cd7721882" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 648.531658] env[61817]: INFO networking_nsxv3.common.synchronization [None req-621c0723-2e6d-4a0c-83c3-84840f1b740a tempest-AttachVolumeShelveTestJSON-1537042233 tempest-AttachVolumeShelveTestJSON-1537042233-project-member] Enqueued Resource ID: a0156293-bf2f-452f-81ef-2c91c2a7807a with Priority: HIGHEST for action security_group_rules [ 648.532205] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0156293-bf2f-452f-81ef-2c91c2a7807a with Priority: HIGHEST for action security_group_rules [ 648.532701] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.532701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 648.532889] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 648.532937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 648.533010] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 648.533162] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0156293-bf2f-452f-81ef-2c91c2a7807a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.533259] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0156293-bf2f-452f-81ef-2c91c2a7807a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 648.533322] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0156293-bf2f-452f-81ef-2c91c2a7807a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 648.533523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0156293-bf2f-452f-81ef-2c91c2a7807a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 648.533644] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0156293-bf2f-452f-81ef-2c91c2a7807a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.546691] env[61817]: INFO networking_nsxv3.common.synchronization [None req-92467c04-1d17-4f04-a072-925cf26aedb1 None None] Enqueued Resource ID: 02f3ebe8-63ee-43cb-bebd-058eec31ae27 with Priority: HIGHEST for action port [ 648.546922] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02f3ebe8-63ee-43cb-bebd-058eec31ae27 with Priority: HIGHEST for action port [ 648.547444] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.547571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 648.547642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 648.547833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 648.547922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 648.548092] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-02f3ebe8-63ee-43cb-bebd-058eec31ae27 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.548189] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02f3ebe8-63ee-43cb-bebd-058eec31ae27" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 648.548247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02f3ebe8-63ee-43cb-bebd-058eec31ae27" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 648.548438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02f3ebe8-63ee-43cb-bebd-058eec31ae27" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 648.548530] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02f3ebe8-63ee-43cb-bebd-058eec31ae27',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.593368] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02f3ebe8-63ee-43cb-bebd-058eec31ae27 [ 648.593580] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.593715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 648.593785] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 648.593990] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 648.594082] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 648.594175] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02f3ebe8-63ee-43cb-bebd-058eec31ae27 already deleted. [ 648.594257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02f3ebe8-63ee-43cb-bebd-058eec31ae27" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 648.647034] env[61817]: INFO networking_nsxv3.common.synchronization [None req-a997345b-2bdf-418a-bc2a-165adf7e840c tempest-AttachVolumeShelveTestJSON-1537042233 tempest-AttachVolumeShelveTestJSON-1537042233-project-member] Enqueued Resource ID: a0156293-bf2f-452f-81ef-2c91c2a7807a with Priority: HIGHEST for action security_group_rules [ 648.647567] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0156293-bf2f-452f-81ef-2c91c2a7807a with Priority: HIGHEST for action security_group_rules [ 648.647877] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.648013] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 648.648090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 648.648290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 648.648384] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 648.648549] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0156293-bf2f-452f-81ef-2c91c2a7807a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.648720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0156293-bf2f-452f-81ef-2c91c2a7807a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 648.715930] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.716109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 648.716194] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 648.716427] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 648.716519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 648.716621] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0156293-bf2f-452f-81ef-2c91c2a7807a already deleted. [ 648.716715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0156293-bf2f-452f-81ef-2c91c2a7807a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 648.716885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0156293-bf2f-452f-81ef-2c91c2a7807a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 648.717051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0156293-bf2f-452f-81ef-2c91c2a7807a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 648.717131] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0156293-bf2f-452f-81ef-2c91c2a7807a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.776831] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.776831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 648.776954] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 648.777237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 648.777237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 648.777237] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0156293-bf2f-452f-81ef-2c91c2a7807a already deleted. [ 648.777383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0156293-bf2f-452f-81ef-2c91c2a7807a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 652.033724] env[61817]: INFO networking_nsxv3.common.synchronization [None req-6370b8e7-172a-4598-92f2-11f976db3556 None None] Enqueued Resource ID: 8d24aa90-f8e3-430e-b931-b05bb4325d4c with Priority: HIGHEST for action port [ 652.034254] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d24aa90-f8e3-430e-b931-b05bb4325d4c with Priority: HIGHEST for action port [ 652.034611] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.034788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 652.034841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 652.035053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 652.035127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 652.035301] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d24aa90-f8e3-430e-b931-b05bb4325d4c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.035404] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d24aa90-f8e3-430e-b931-b05bb4325d4c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 652.035478] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d24aa90-f8e3-430e-b931-b05bb4325d4c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 652.035696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d24aa90-f8e3-430e-b931-b05bb4325d4c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 652.035791] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d24aa90-f8e3-430e-b931-b05bb4325d4c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.051095] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d24aa90-f8e3-430e-b931-b05bb4325d4c [ 652.051320] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.051461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 652.051578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 652.056506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 652.056506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 652.056506] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d24aa90-f8e3-430e-b931-b05bb4325d4c already deleted. [ 652.056506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d24aa90-f8e3-430e-b931-b05bb4325d4c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 652.909875] env[61817]: INFO networking_nsxv3.common.synchronization [None req-4d1ff451-0120-4525-899f-3e9cdaa88beb None None] Enqueued Resource ID: 9dff0633-a147-49a3-a1fe-28f89122bc9b with Priority: HIGHEST for action port [ 652.910348] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dff0633-a147-49a3-a1fe-28f89122bc9b with Priority: HIGHEST for action port [ 652.910736] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.910863] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 652.910929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 652.911141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 652.911216] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 652.911365] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dff0633-a147-49a3-a1fe-28f89122bc9b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.911457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dff0633-a147-49a3-a1fe-28f89122bc9b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 652.911513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dff0633-a147-49a3-a1fe-28f89122bc9b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 652.912060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dff0633-a147-49a3-a1fe-28f89122bc9b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 652.912060] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dff0633-a147-49a3-a1fe-28f89122bc9b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.948433] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dff0633-a147-49a3-a1fe-28f89122bc9b [ 652.948717] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.948790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 652.948828] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 652.949005] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 652.949092] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 652.949180] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dff0633-a147-49a3-a1fe-28f89122bc9b already deleted. [ 652.949255] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dff0633-a147-49a3-a1fe-28f89122bc9b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 653.599156] env[61817]: INFO networking_nsxv3.common.synchronization [None req-d6f57f0a-c09d-43fd-801b-3e2248a3fd5f None None] Enqueued Resource ID: 6e36ca2a-825f-40f6-b94d-df44f48bdf21 with Priority: HIGHEST for action port [ 653.599454] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e36ca2a-825f-40f6-b94d-df44f48bdf21 with Priority: HIGHEST for action port [ 653.600023] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.600114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 653.600159] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 653.600341] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 653.600424] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 653.602198] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e36ca2a-825f-40f6-b94d-df44f48bdf21 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.602198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e36ca2a-825f-40f6-b94d-df44f48bdf21" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 653.602198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e36ca2a-825f-40f6-b94d-df44f48bdf21" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 653.602198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e36ca2a-825f-40f6-b94d-df44f48bdf21" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 653.602198] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e36ca2a-825f-40f6-b94d-df44f48bdf21',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.612359] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e36ca2a-825f-40f6-b94d-df44f48bdf21 [ 653.612574] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.612706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 653.612766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 653.612966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 653.613057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 653.613150] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e36ca2a-825f-40f6-b94d-df44f48bdf21 already deleted. [ 653.613230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e36ca2a-825f-40f6-b94d-df44f48bdf21" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 654.286236] env[61817]: INFO networking_nsxv3.common.synchronization [req-990bfcca-c2ce-4de2-83f9-89159fd6125b req-6226e334-f126-45dd-8210-7ca167060f47 tempest-SecurityGroupRulesNegativeTestJSON-36285544 tempest-SecurityGroupRulesNegativeTestJSON-36285544-project-member] Enqueued Resource ID: cdc42be7-77c2-4371-b41e-8447fad108a5 with Priority: HIGHEST for action security_group_rules [ 654.286670] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc42be7-77c2-4371-b41e-8447fad108a5 with Priority: HIGHEST for action security_group_rules [ 654.286971] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.287467] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 654.287467] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 654.287467] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 654.287467] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 654.287596] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdc42be7-77c2-4371-b41e-8447fad108a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.287666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdc42be7-77c2-4371-b41e-8447fad108a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 654.287713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdc42be7-77c2-4371-b41e-8447fad108a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 654.287912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdc42be7-77c2-4371-b41e-8447fad108a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 654.288025] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdc42be7-77c2-4371-b41e-8447fad108a5',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.355523] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.355666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 654.355760] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 654.355953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 654.356124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 654.356223] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdc42be7-77c2-4371-b41e-8447fad108a5 already deleted. [ 654.356312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdc42be7-77c2-4371-b41e-8447fad108a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 654.858825] env[61817]: INFO networking_nsxv3.common.synchronization [None req-a188a32e-d161-448a-b2ad-2274e3af0edf None None] Enqueued Resource ID: b7dc1efa-5cbd-494f-aab7-e9450ce9c8ce with Priority: HIGHEST for action port [ 654.858825] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7dc1efa-5cbd-494f-aab7-e9450ce9c8ce with Priority: HIGHEST for action port [ 654.858825] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.859252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 654.859252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 654.859252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 654.859252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 654.859435] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7dc1efa-5cbd-494f-aab7-e9450ce9c8ce taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.859435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7dc1efa-5cbd-494f-aab7-e9450ce9c8ce" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 654.859535] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7dc1efa-5cbd-494f-aab7-e9450ce9c8ce" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 654.859659] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7dc1efa-5cbd-494f-aab7-e9450ce9c8ce" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 654.859745] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7dc1efa-5cbd-494f-aab7-e9450ce9c8ce',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.889580] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7dc1efa-5cbd-494f-aab7-e9450ce9c8ce [ 654.889650] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.889716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 654.889790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 654.889995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 654.890087] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 654.890179] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7dc1efa-5cbd-494f-aab7-e9450ce9c8ce already deleted. [ 654.890261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7dc1efa-5cbd-494f-aab7-e9450ce9c8ce" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 655.351677] env[61817]: INFO networking_nsxv3.common.synchronization [None req-2ef10366-18a0-4b1a-82a7-c7072e80ac63 tempest-AttachInterfacesTestJSON-327680650 tempest-AttachInterfacesTestJSON-327680650-project-member] Enqueued Resource ID: b6e9cb51-b3b8-4513-ad86-fda89e18df6f with Priority: HIGHEST for action security_group_rules [ 655.352257] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e9cb51-b3b8-4513-ad86-fda89e18df6f with Priority: HIGHEST for action security_group_rules [ 655.352573] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.352991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 655.353055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 655.353254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 655.353333] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 655.353482] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e9cb51-b3b8-4513-ad86-fda89e18df6f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.353588] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e9cb51-b3b8-4513-ad86-fda89e18df6f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 655.353650] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e9cb51-b3b8-4513-ad86-fda89e18df6f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 655.353830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e9cb51-b3b8-4513-ad86-fda89e18df6f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 655.353907] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e9cb51-b3b8-4513-ad86-fda89e18df6f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.437600] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.437911] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 655.438069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 655.438359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 655.438646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 655.438846] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e9cb51-b3b8-4513-ad86-fda89e18df6f already deleted. [ 655.439031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e9cb51-b3b8-4513-ad86-fda89e18df6f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 655.457610] env[61817]: INFO networking_nsxv3.common.synchronization [None req-c68fed0e-5feb-469f-acf0-cd5355d51a3a tempest-AttachInterfacesTestJSON-327680650 tempest-AttachInterfacesTestJSON-327680650-project-member] Enqueued Resource ID: b6e9cb51-b3b8-4513-ad86-fda89e18df6f with Priority: HIGHEST for action security_group_rules [ 655.458591] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e9cb51-b3b8-4513-ad86-fda89e18df6f with Priority: HIGHEST for action security_group_rules [ 655.459009] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.459436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 655.459594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 655.459881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 655.460121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 655.460393] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6e9cb51-b3b8-4513-ad86-fda89e18df6f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.460622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6e9cb51-b3b8-4513-ad86-fda89e18df6f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 655.460867] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6e9cb51-b3b8-4513-ad86-fda89e18df6f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 655.461484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6e9cb51-b3b8-4513-ad86-fda89e18df6f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 655.462001] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6e9cb51-b3b8-4513-ad86-fda89e18df6f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.498129] env[61817]: INFO networking_nsxv3.common.synchronization [None req-7ca3a5a9-89f9-46d8-926d-b5f314aceeb6 None None] Enqueued Resource ID: 7cd097de-07db-4635-9a82-139bf6859ac8 with Priority: HIGHEST for action port [ 655.498541] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd097de-07db-4635-9a82-139bf6859ac8 with Priority: HIGHEST for action port [ 655.499253] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.499521] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 655.499686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 655.499991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 655.500193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 655.500433] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cd097de-07db-4635-9a82-139bf6859ac8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.500798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cd097de-07db-4635-9a82-139bf6859ac8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 655.501045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cd097de-07db-4635-9a82-139bf6859ac8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 655.501394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cd097de-07db-4635-9a82-139bf6859ac8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 655.501772] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cd097de-07db-4635-9a82-139bf6859ac8',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.549361] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cd097de-07db-4635-9a82-139bf6859ac8 [ 655.549770] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.550054] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 655.550220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 655.550576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 655.550787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 655.550968] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cd097de-07db-4635-9a82-139bf6859ac8 already deleted. [ 655.551160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cd097de-07db-4635-9a82-139bf6859ac8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 655.571087] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.571373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 655.571662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 655.571963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 655.572179] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 655.572362] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6e9cb51-b3b8-4513-ad86-fda89e18df6f already deleted. [ 655.572547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6e9cb51-b3b8-4513-ad86-fda89e18df6f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 655.720384] env[61817]: INFO networking_nsxv3.common.synchronization [req-867f14d5-aacf-45b4-a690-d2e499037e35 req-207991a9-62fb-4ece-a536-38702e433777 tempest-SecurityGroupRulesNegativeTestJSON-36285544 tempest-SecurityGroupRulesNegativeTestJSON-36285544-project-member] Enqueued Resource ID: cdc42be7-77c2-4371-b41e-8447fad108a5 with Priority: HIGHEST for action security_group_rules [ 655.721881] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc42be7-77c2-4371-b41e-8447fad108a5 with Priority: HIGHEST for action security_group_rules [ 655.722548] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.723433] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 655.723950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 655.724841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 655.725048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 655.726078] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cdc42be7-77c2-4371-b41e-8447fad108a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.726533] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cdc42be7-77c2-4371-b41e-8447fad108a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 655.726698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cdc42be7-77c2-4371-b41e-8447fad108a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 655.726971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cdc42be7-77c2-4371-b41e-8447fad108a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 655.727601] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cdc42be7-77c2-4371-b41e-8447fad108a5',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.775756] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.775756] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 655.775756] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 655.775756] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 655.776398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 655.776398] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cdc42be7-77c2-4371-b41e-8447fad108a5 already deleted. [ 655.776398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cdc42be7-77c2-4371-b41e-8447fad108a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 656.252893] env[61817]: INFO networking_nsxv3.common.synchronization [None req-d98c54ba-cd62-4a26-97c8-464cf704f401 None None] Enqueued Resource ID: b23100f6-c98b-45a7-a4da-913f1d844b19 with Priority: HIGHEST for action port [ 656.253184] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b23100f6-c98b-45a7-a4da-913f1d844b19 with Priority: HIGHEST for action port [ 656.253730] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.253862] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 656.253931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 656.254135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 656.254222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 656.254381] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-b23100f6-c98b-45a7-a4da-913f1d844b19 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.254475] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b23100f6-c98b-45a7-a4da-913f1d844b19" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 656.254534] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b23100f6-c98b-45a7-a4da-913f1d844b19" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 656.254733] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b23100f6-c98b-45a7-a4da-913f1d844b19" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 656.254816] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b23100f6-c98b-45a7-a4da-913f1d844b19',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.282250] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b23100f6-c98b-45a7-a4da-913f1d844b19 [ 656.282734] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.282734] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 656.283275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 656.284028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 656.284028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 656.284028] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b23100f6-c98b-45a7-a4da-913f1d844b19 already deleted. [ 656.284202] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b23100f6-c98b-45a7-a4da-913f1d844b19" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 661.254667] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 661.255088] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 663.144869] env[61817]: INFO networking_nsxv3.common.synchronization [None req-f9936e7d-1522-4ac7-a3c8-ac46ff3c2e78 None None] Enqueued Resource ID: b65c58f0-094d-4f01-9aa5-9dfd8bf7fb9b with Priority: HIGHEST for action port [ 663.145120] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b65c58f0-094d-4f01-9aa5-9dfd8bf7fb9b with Priority: HIGHEST for action port [ 663.145715] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.145830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.145894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.146103] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.146182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.146330] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-b65c58f0-094d-4f01-9aa5-9dfd8bf7fb9b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.146416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b65c58f0-094d-4f01-9aa5-9dfd8bf7fb9b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.146480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b65c58f0-094d-4f01-9aa5-9dfd8bf7fb9b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.146681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b65c58f0-094d-4f01-9aa5-9dfd8bf7fb9b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.146756] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b65c58f0-094d-4f01-9aa5-9dfd8bf7fb9b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.178868] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b65c58f0-094d-4f01-9aa5-9dfd8bf7fb9b [ 663.178868] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.178868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 663.178868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 663.178868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 663.178868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 663.178868] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b65c58f0-094d-4f01-9aa5-9dfd8bf7fb9b already deleted. [ 663.178868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b65c58f0-094d-4f01-9aa5-9dfd8bf7fb9b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 665.433603] env[61817]: INFO networking_nsxv3.common.synchronization [None req-5e9bb97d-ab15-4346-9129-e44f81627f25 None None] Enqueued Resource ID: 24b75c89-996a-4794-be3a-1dc3e4dd56c2 with Priority: HIGHEST for action port [ 665.433883] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24b75c89-996a-4794-be3a-1dc3e4dd56c2 with Priority: HIGHEST for action port [ 665.434410] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.434531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 665.434589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 665.434873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 665.434873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 665.435004] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-24b75c89-996a-4794-be3a-1dc3e4dd56c2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.435091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24b75c89-996a-4794-be3a-1dc3e4dd56c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 665.435148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24b75c89-996a-4794-be3a-1dc3e4dd56c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 665.435358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24b75c89-996a-4794-be3a-1dc3e4dd56c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 665.435471] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24b75c89-996a-4794-be3a-1dc3e4dd56c2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.445378] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24b75c89-996a-4794-be3a-1dc3e4dd56c2 [ 665.445538] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.445657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 665.445719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 665.445903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 665.445986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 665.446070] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24b75c89-996a-4794-be3a-1dc3e4dd56c2 already deleted. [ 665.446145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24b75c89-996a-4794-be3a-1dc3e4dd56c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 667.280430] env[61817]: INFO networking_nsxv3.common.synchronization [None req-72fc374d-e144-482d-81b7-42c13e1d3c3a None None] Enqueued Resource ID: bcc9109b-892a-4d1b-aaf5-8f9dd4acc3c2 with Priority: HIGHEST for action port [ 667.280430] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcc9109b-892a-4d1b-aaf5-8f9dd4acc3c2 with Priority: HIGHEST for action port [ 667.280430] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.280430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 667.280430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 667.280430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 667.281141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 667.281141] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcc9109b-892a-4d1b-aaf5-8f9dd4acc3c2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.281141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcc9109b-892a-4d1b-aaf5-8f9dd4acc3c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 667.281141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcc9109b-892a-4d1b-aaf5-8f9dd4acc3c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 667.281141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcc9109b-892a-4d1b-aaf5-8f9dd4acc3c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 667.281141] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcc9109b-892a-4d1b-aaf5-8f9dd4acc3c2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.339010] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bcc9109b-892a-4d1b-aaf5-8f9dd4acc3c2 [ 667.339239] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.339516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 667.339516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 667.339673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 667.339759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 667.339851] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bcc9109b-892a-4d1b-aaf5-8f9dd4acc3c2 already deleted. [ 667.339928] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcc9109b-892a-4d1b-aaf5-8f9dd4acc3c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 669.544782] env[61817]: INFO networking_nsxv3.common.synchronization [None req-80ad5f43-6a32-4daf-a4a4-dc257746bda6 None None] Enqueued Resource ID: afec57fe-2dfc-4550-b9ab-cebd1c1e5cc7 with Priority: HIGHEST for action port [ 669.545043] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afec57fe-2dfc-4550-b9ab-cebd1c1e5cc7 with Priority: HIGHEST for action port [ 669.545833] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.546010] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 669.546062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 669.546218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 669.546299] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 669.546450] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-afec57fe-2dfc-4550-b9ab-cebd1c1e5cc7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.547445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afec57fe-2dfc-4550-b9ab-cebd1c1e5cc7" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 669.547445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afec57fe-2dfc-4550-b9ab-cebd1c1e5cc7" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 669.547445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afec57fe-2dfc-4550-b9ab-cebd1c1e5cc7" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 669.547445] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afec57fe-2dfc-4550-b9ab-cebd1c1e5cc7',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.564317] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afec57fe-2dfc-4550-b9ab-cebd1c1e5cc7 [ 669.564582] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.564757] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 669.564850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 669.565073] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 669.565324] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 669.565324] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afec57fe-2dfc-4550-b9ab-cebd1c1e5cc7 already deleted. [ 669.565421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afec57fe-2dfc-4550-b9ab-cebd1c1e5cc7" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 670.361142] env[61817]: INFO networking_nsxv3.common.synchronization [None req-60bbfff9-0ade-4f2a-8002-74e6d8b782f3 None None] Enqueued Resource ID: ebd9d804-e5a9-45d8-9b65-06b1b70677bd with Priority: HIGHEST for action port [ 670.361390] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd9d804-e5a9-45d8-9b65-06b1b70677bd with Priority: HIGHEST for action port [ 670.362018] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.362170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 670.362246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 670.362407] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 670.362487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 670.362636] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebd9d804-e5a9-45d8-9b65-06b1b70677bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.362727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebd9d804-e5a9-45d8-9b65-06b1b70677bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 670.362785] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebd9d804-e5a9-45d8-9b65-06b1b70677bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 670.362976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebd9d804-e5a9-45d8-9b65-06b1b70677bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 670.363050] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebd9d804-e5a9-45d8-9b65-06b1b70677bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.467897] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebd9d804-e5a9-45d8-9b65-06b1b70677bd [ 670.468128] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.468255] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 670.468319] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 670.468524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 670.468616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 670.468689] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebd9d804-e5a9-45d8-9b65-06b1b70677bd already deleted. [ 670.468764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebd9d804-e5a9-45d8-9b65-06b1b70677bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 671.972590] env[61817]: INFO networking_nsxv3.common.synchronization [None req-22d40947-b6a0-470c-be3d-70b27d0f5ab5 None None] Enqueued Resource ID: edd8d1ca-c3d0-451b-bf8a-5e3052841926 with Priority: HIGHEST for action port [ 671.972911] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd8d1ca-c3d0-451b-bf8a-5e3052841926 with Priority: HIGHEST for action port [ 671.973853] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.973979] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 671.974046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 671.974237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 671.974317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 671.974468] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-edd8d1ca-c3d0-451b-bf8a-5e3052841926 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.974561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edd8d1ca-c3d0-451b-bf8a-5e3052841926" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 671.974620] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edd8d1ca-c3d0-451b-bf8a-5e3052841926" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 671.974824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edd8d1ca-c3d0-451b-bf8a-5e3052841926" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 671.974900] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edd8d1ca-c3d0-451b-bf8a-5e3052841926',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.986296] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port edd8d1ca-c3d0-451b-bf8a-5e3052841926 [ 671.986488] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.986622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 671.986693] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 671.987034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 671.987034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 671.987129] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:edd8d1ca-c3d0-451b-bf8a-5e3052841926 already deleted. [ 671.987129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edd8d1ca-c3d0-451b-bf8a-5e3052841926" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 676.974019] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 676.974272] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 681.975407] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 681.975679] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 686.976496] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 686.976772] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 687.537263] env[61817]: INFO networking_nsxv3.common.synchronization [req-73a72652-ded3-4f8e-bf78-f0b9d3b43d84 req-c849b00b-3a22-4144-86b5-f8a24df46a23 tempest-ImagesNegativeTestJSON-326110035 tempest-ImagesNegativeTestJSON-326110035-project-member] Enqueued Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGHEST for action security_group_members [ 687.537806] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGHEST for action security_group_members [ 687.538116] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.538244] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.538312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.538593] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.538707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.538863] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.538973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.539028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.539227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.539361] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.539786] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.539874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.540053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.540148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.540237] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.550055] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.550205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.550205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.550399] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.550486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.550687] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.550782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.550839] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.550986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.551062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.551186] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 already deleted. [ 687.551287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.835769] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.836046] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.836105] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.836406] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.836509] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.836786] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-515 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.836962] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-515" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.837178] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-515" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.837411] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-515" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.837645] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.837812] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.837926] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.838146] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.838303] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.838510] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-515" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.838791] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.838959] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.839094] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.839348] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.839485] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.839976] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-d78e0d1d-229a-4a36-86a2-a2326aa34843 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.840185] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-d78e0d1d-229a-4a36-86a2-a2326aa34843" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.840317] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-d78e0d1d-229a-4a36-86a2-a2326aa34843" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.841077] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-d78e0d1d-229a-4a36-86a2-a2326aa34843" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.841217] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d78e0d1d-229a-4a36-86a2-a2326aa34843',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.858902] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.859074] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.859194] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.859464] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.859609] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.859756] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port d78e0d1d-229a-4a36-86a2-a2326aa34843 not found, creating... [ 687.860054] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.860182] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.860302] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.860518] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.860675] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.860950] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.861098] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.861219] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.861424] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.861553] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.861707] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: d78e0d1d-229a-4a36-86a2-a2326aa34843 is going to be created. [ 687.883175] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.883456] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 687.883623] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 687.883949] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 687.884299] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 687.884557] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-d78e0d1d-229a-4a36-86a2-a2326aa34843" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 688.116217] env[61817]: INFO networking_nsxv3.common.synchronization [req-73a72652-ded3-4f8e-bf78-f0b9d3b43d84 req-f02538c7-29e2-4d1e-99c4-cf488999e7d2 service neutron] Enqueued Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGHEST for action security_group_rules [ 688.116602] env[61817]: INFO networking_nsxv3.common.synchronization [req-73a72652-ded3-4f8e-bf78-f0b9d3b43d84 req-f02538c7-29e2-4d1e-99c4-cf488999e7d2 service neutron] Enqueued Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGHEST for action security_group_members [ 688.116602] env[61817]: INFO networking_nsxv3.common.synchronization [req-73a72652-ded3-4f8e-bf78-f0b9d3b43d84 req-f02538c7-29e2-4d1e-99c4-cf488999e7d2 service neutron] Enqueued Resource ID: d78e0d1d-229a-4a36-86a2-a2326aa34843 with Priority: HIGHEST for action port [ 688.116784] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGHEST for action security_group_rules [ 688.116948] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGHEST for action security_group_members [ 688.117089] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d78e0d1d-229a-4a36-86a2-a2326aa34843 with Priority: HIGHEST for action port [ 688.117685] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.118030] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.118030] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.118098] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.118335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 688.118335] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.118490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.118490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.118727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.118727] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.119908] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.119988] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.125680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.125910] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.126000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 688.126178] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.126284] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.126344] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.126492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.126633] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.126730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.126792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.126925] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.127005] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 688.127093] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.129818] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.130018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.130018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.130220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.130286] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 688.130412] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-d78e0d1d-229a-4a36-86a2-a2326aa34843 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.130508] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d78e0d1d-229a-4a36-86a2-a2326aa34843" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.130751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d78e0d1d-229a-4a36-86a2-a2326aa34843" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.130948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d78e0d1d-229a-4a36-86a2-a2326aa34843" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.131066] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d78e0d1d-229a-4a36-86a2-a2326aa34843',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.153636] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.171444] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.171746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.171746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.171969] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.172130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 688.172279] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.172366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.175030] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.186795] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d78e0d1d-229a-4a36-86a2-a2326aa34843 with status ACTIVE [ 688.187012] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.187119] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.187166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.187356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.187445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 688.187607] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.187723] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.187767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.187897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.187970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 688.192994] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.193144] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.193186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.193343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.193421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 688.193506] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 is going to be created. [ 688.233570] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.233866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.233866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.234031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.234193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 688.252230] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 in Status: UNINITIALIZED for 2s [ 688.547916] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.548030] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.548277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.548310] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.548402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 688.548724] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d78e0d1d-229a-4a36-86a2-a2326aa34843 is going to be updated. [ 688.574394] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.574394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 688.574394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 688.574394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 688.574394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 688.574394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d78e0d1d-229a-4a36-86a2-a2326aa34843" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.267249] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 in Status: SUCCESS [ 690.267572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.267572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.267779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.268015] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.268139] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 690.268639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.268639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.268639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.268639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.268886] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.278311] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.278437] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 690.278712] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.278712] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.278821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.279842] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.279842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 690.279842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.279842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.279842] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.279842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 690.279842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.279842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.279842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.279842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.280246] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.280246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 690.280246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.280343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.280386] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.280553] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.280633] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 690.280693] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.280849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.280967] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.281060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 690.281150] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.281252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.281351] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.281402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.281490] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.287894] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 916dc4e3-1bc8-4ba5-b319-d9d0dee54564: rpc.has_security_group_logging(os_id): False [ 690.306975] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.307116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 690.307184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.307412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.307515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.307740] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.307839] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 690.307901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.308077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.308155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.308326] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.308434] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 690.308470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.308646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.308688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.308882] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.308972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 690.309030] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.309165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.309237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.309319] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 is going to be created. [ 690.398560] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.398783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 690.398834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 690.400044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 690.400044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 690.411379] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 in Status: IN_PROGRESS for 2s [ 692.424729] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 in Status: SUCCESS [ 692.424729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 693.118030] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 693.118169] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 693.973970] env[61817]: INFO networking_nsxv3.common.synchronization [None req-5711c37c-2d7c-49b2-b482-6293d1f3fea4 tempest-TaggedBootDevicesTest-1269454556 tempest-TaggedBootDevicesTest-1269454556-project-member] Enqueued Resource ID: 63fbbdc0-9c08-446c-82d5-8742d9083ab6 with Priority: HIGHEST for action security_group_members [ 693.974440] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63fbbdc0-9c08-446c-82d5-8742d9083ab6 with Priority: HIGHEST for action security_group_members [ 693.974795] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.974928] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 693.974995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 693.975212] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 693.975303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 693.975457] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-63fbbdc0-9c08-446c-82d5-8742d9083ab6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.975553] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 693.975617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 693.975964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 693.975964] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.976099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 693.976099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 693.976247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 693.976371] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 693.976417] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63fbbdc0-9c08-446c-82d5-8742d9083ab6',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.989472] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.989667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 693.989724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 693.989904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 693.989998] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 693.990197] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.990329] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 693.990428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 693.990650] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 693.990739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 693.990834] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63fbbdc0-9c08-446c-82d5-8742d9083ab6 already deleted. [ 693.990916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 694.843820] env[61817]: INFO networking_nsxv3.common.synchronization [None req-2510d78a-405b-4bb0-ac96-4a9b5f407764 tempest-TaggedBootDevicesTest-1269454556 tempest-TaggedBootDevicesTest-1269454556-project-member] Enqueued Resource ID: 63fbbdc0-9c08-446c-82d5-8742d9083ab6 with Priority: HIGHEST for action security_group_members [ 694.844336] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63fbbdc0-9c08-446c-82d5-8742d9083ab6 with Priority: HIGHEST for action security_group_members [ 694.844642] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.844767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 694.844835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 694.845032] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 694.845118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 694.845266] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-63fbbdc0-9c08-446c-82d5-8742d9083ab6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.845360] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 694.845455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 694.845593] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 694.845691] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.845785] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 694.845842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 694.846013] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 694.846093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 694.846182] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63fbbdc0-9c08-446c-82d5-8742d9083ab6',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.857364] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.857519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 694.857588] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 694.857770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 694.858498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 694.858498] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.858498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 694.858498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 694.858498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 694.858498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 694.858498] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63fbbdc0-9c08-446c-82d5-8742d9083ab6 already deleted. [ 694.858748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 695.801293] env[61817]: INFO networking_nsxv3.common.synchronization [None req-897d6dc5-afff-4d36-b6e7-180a64c5ac0b tempest-TaggedBootDevicesTest-1269454556 tempest-TaggedBootDevicesTest-1269454556-project-member] Enqueued Resource ID: 8ee3f755-e9d3-4211-9672-35e20127beb0 with Priority: HIGHEST for action security_group_rules [ 695.801604] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee3f755-e9d3-4211-9672-35e20127beb0 with Priority: HIGHEST for action security_group_rules [ 695.801897] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.802012] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 695.802077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 695.802285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 695.802376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 695.802535] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ee3f755-e9d3-4211-9672-35e20127beb0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.802631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ee3f755-e9d3-4211-9672-35e20127beb0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 695.802694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ee3f755-e9d3-4211-9672-35e20127beb0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 695.802907] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ee3f755-e9d3-4211-9672-35e20127beb0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 695.802994] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ee3f755-e9d3-4211-9672-35e20127beb0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.835337] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.835479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 695.835519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 695.835712] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 695.835811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 695.835892] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ee3f755-e9d3-4211-9672-35e20127beb0 already deleted. [ 695.835968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ee3f755-e9d3-4211-9672-35e20127beb0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 695.890780] env[61817]: INFO networking_nsxv3.common.synchronization [None req-a7eadf22-8fd6-47f6-bfd6-e1cab4f9f456 tempest-TaggedBootDevicesTest-1269454556 tempest-TaggedBootDevicesTest-1269454556-project-member] Enqueued Resource ID: 8ee3f755-e9d3-4211-9672-35e20127beb0 with Priority: HIGHEST for action security_group_rules [ 695.891286] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee3f755-e9d3-4211-9672-35e20127beb0 with Priority: HIGHEST for action security_group_rules [ 695.891608] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.891749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 695.891822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 695.892025] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 695.892111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 695.892261] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ee3f755-e9d3-4211-9672-35e20127beb0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.892352] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ee3f755-e9d3-4211-9672-35e20127beb0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 695.892411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ee3f755-e9d3-4211-9672-35e20127beb0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 695.892556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ee3f755-e9d3-4211-9672-35e20127beb0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 695.892627] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ee3f755-e9d3-4211-9672-35e20127beb0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.924878] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.925064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 695.925162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 695.925385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 695.925484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 695.925705] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ee3f755-e9d3-4211-9672-35e20127beb0 already deleted. [ 695.925802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ee3f755-e9d3-4211-9672-35e20127beb0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 700.894395] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 700.894751] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 705.896176] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 705.896176] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 710.896689] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 710.897039] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 715.897924] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 715.898232] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 720.901407] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 720.901713] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 725.903078] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 725.903396] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 730.904286] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 730.904602] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 735.905111] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 735.905371] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 737.388144] env[61817]: INFO networking_nsxv3.common.synchronization [req-c57f9007-b228-4bad-ba10-81852dc5e28f req-9626747f-ce32-46aa-9b51-5acc43bd762a tempest-ServerGroupTestJSON-1144577638 tempest-ServerGroupTestJSON-1144577638-project-member] Enqueued Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGHEST for action security_group_members [ 737.388672] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGHEST for action security_group_members [ 737.388978] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.389110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.389173] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.389367] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.389448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.389638] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.389731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.389731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.389912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.390049] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.390130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.390191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.390360] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.390422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.390481] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.401638] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.401786] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.401844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.402037] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.402122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.402312] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.402404] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.402464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.402624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.402725] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.402816] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c already deleted. [ 737.402893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.707150] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.707355] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.707480] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.707743] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.707895] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.708159] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-926 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.708310] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-926" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.708436] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-926" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.708709] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-926" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.708957] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.709107] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.709220] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.709425] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.709560] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.709775] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-926" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.710044] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.710196] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.710307] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.710510] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.710702] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.710940] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-62fdd978-7275-4c69-bc24-dd1fda84275a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.711091] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-62fdd978-7275-4c69-bc24-dd1fda84275a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.711203] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-62fdd978-7275-4c69-bc24-dd1fda84275a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.711442] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-62fdd978-7275-4c69-bc24-dd1fda84275a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.711595] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62fdd978-7275-4c69-bc24-dd1fda84275a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.727257] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.727470] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.727610] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.727879] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.728037] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.728189] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 62fdd978-7275-4c69-bc24-dd1fda84275a not found, creating... [ 737.728444] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.728599] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.728718] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.728940] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.729080] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.729356] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.729509] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.729625] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.729832] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.729963] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.730099] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 62fdd978-7275-4c69-bc24-dd1fda84275a is going to be created. [ 737.766275] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.766486] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 737.766606] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 737.766870] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 737.767093] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 737.767330] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-62fdd978-7275-4c69-bc24-dd1fda84275a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 738.003753] env[61817]: INFO networking_nsxv3.common.synchronization [req-c57f9007-b228-4bad-ba10-81852dc5e28f req-19f6b49e-1330-448b-99b1-fc43e850a1ee service neutron] Enqueued Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGHEST for action security_group_rules [ 738.003928] env[61817]: INFO networking_nsxv3.common.synchronization [req-c57f9007-b228-4bad-ba10-81852dc5e28f req-19f6b49e-1330-448b-99b1-fc43e850a1ee service neutron] Enqueued Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGHEST for action security_group_members [ 738.004076] env[61817]: INFO networking_nsxv3.common.synchronization [req-c57f9007-b228-4bad-ba10-81852dc5e28f req-19f6b49e-1330-448b-99b1-fc43e850a1ee service neutron] Enqueued Resource ID: 62fdd978-7275-4c69-bc24-dd1fda84275a with Priority: HIGHEST for action port [ 738.004295] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGHEST for action security_group_rules [ 738.004422] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGHEST for action security_group_members [ 738.004518] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62fdd978-7275-4c69-bc24-dd1fda84275a with Priority: HIGHEST for action port [ 738.005044] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.005172] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.005240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.005472] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.005553] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 738.005701] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.005798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.005873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.006046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.006123] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.006900] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.007006] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.007070] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.007224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.007300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 738.007438] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.008224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.008224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.008224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.008224] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.008224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.008224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.008841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.009025] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 738.009125] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.011572] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.011572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.011572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.011572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.011572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 738.011572] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-62fdd978-7275-4c69-bc24-dd1fda84275a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.011572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62fdd978-7275-4c69-bc24-dd1fda84275a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.011572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62fdd978-7275-4c69-bc24-dd1fda84275a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.011572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62fdd978-7275-4c69-bc24-dd1fda84275a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.011572] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62fdd978-7275-4c69-bc24-dd1fda84275a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.020452] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.051368] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62fdd978-7275-4c69-bc24-dd1fda84275a with status ACTIVE [ 738.051368] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.051368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.051368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.051368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.051368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 738.051368] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.051368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.051368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.051368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.051368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 738.051368] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.051368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.051368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.051368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.051368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 738.052129] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.052129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.056912] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.068595] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.068945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.069117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.069405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.069591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 738.069773] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c is going to be created. [ 738.113989] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.114534] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.114865] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.115208] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.115497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 738.137091] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c in Status: UNINITIALIZED for 2s [ 738.484972] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.485374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.485374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.485535] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.485575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 738.485648] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62fdd978-7275-4c69-bc24-dd1fda84275a is going to be updated. [ 738.509509] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.509665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 738.509860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 738.510091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 738.510350] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 738.510429] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62fdd978-7275-4c69-bc24-dd1fda84275a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.147940] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c in Status: SUCCESS [ 740.148231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.148352] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.148574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.148764] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.148915] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 740.148980] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.149143] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.149227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.149337] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.149395] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.159307] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.159471] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 740.159537] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.159672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.159768] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.159904] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.160032] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 740.160117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.160270] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.160412] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.160501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 740.160614] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.160701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.160780] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.160852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.161007] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.161170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 740.161170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.161321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.161393] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.161540] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.161636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 740.161705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.161829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.161961] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.162049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 740.162110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.162235] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.162307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.162387] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.162491] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.169477] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5573ccf-d866-40ac-9bb4-1fa04e91ef9c: rpc.has_security_group_logging(os_id): False [ 740.188941] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.189182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 740.189182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.189398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.189534] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.189735] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.189835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 740.189891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.190049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.190126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.190323] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.190419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 740.190493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.190709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.190824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.191027] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.191123] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 740.191178] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.191326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.191402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.191488] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c is going to be created. [ 740.249016] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.249359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 740.249359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 740.249549] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 740.249757] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 740.261427] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c in Status: IN_PROGRESS for 2s [ 742.274669] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c in Status: SUCCESS [ 742.274923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 743.005279] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 743.005526] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 748.006849] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 748.007184] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 753.007840] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 753.008158] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 756.999086] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 756.999370] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:1 started [ 758.009433] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 758.009705] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 761.837240] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.837240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 761.837240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 761.837240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 761.837240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 761.837240] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.837240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 761.837240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 761.837240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 761.837240] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.847520] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.855267] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.863083] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 761.863083] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 762.518845] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.519102] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.519102] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.519267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.531935] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 762.532390] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.533116] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 762.564103] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.564265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.564317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.564523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.568488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.568878] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 762.568956] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 762.569029] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 762.593503] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.593700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.593700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.593908] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.594304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.594425] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 762.623666] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.623666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.624061] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.624101] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.624311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.624448] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 762.657650] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.657870] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.657870] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.658068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.658207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.658353] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:6. [ 762.658433] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'916dc4e3-1bc8-4ba5-b319-d9d0dee54564', '9efe5fcd-faf9-44dd-ac10-abd106d2dc72', '1266a9f5-7050-4473-ad65-329e9724ea7d', '5233168b-5f93-4bb0-bac2-dd279d965d46', '905dd5f8-1bc0-4560-8294-1733c7eaf6f4', 'c5573ccf-d866-40ac-9bb4-1fa04e91ef9c'} {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 762.658500] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 762.678862] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.679026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.679100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.679331] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.679426] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.679539] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 762.679613] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 762.679685] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 762.709598] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.709751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.709823] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.710033] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.710288] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.710433] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 762.710509] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 762.710606] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 762.710680] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 762.710754] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 6/6 resources of Type:Security Group Rules [ 762.710826] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGH for action security_group_rules [ 762.710904] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGH for action security_group_rules [ 762.710969] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGH for action security_group_rules [ 762.711032] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 762.711095] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGH for action security_group_rules [ 762.711158] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGH for action security_group_rules [ 762.711225] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 762.711286] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 762.711464] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.711567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.711667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.711792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.711870] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.712056] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.712152] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.712211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.712350] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.712424] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.712587] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.712681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.712740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.712888] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.712953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.713113] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.713204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.713265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.713401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.713475] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.713635] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.713729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.713788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.713924] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.713997] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.714158] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.714248] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.714306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.714459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.714508] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.714668] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.714760] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.714819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.714953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.715025] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.715185] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.715272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.715331] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.715465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.715537] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.715706] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.715805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.715864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.716008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.716105] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.716271] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.716362] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.716422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.716560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.716635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.716794] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.716885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.716944] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.717078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.717149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.717309] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.717397] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.717456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.717590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.717663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.717758] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 762.717820] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 762.717887] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 762.760633] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1030 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.760852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.760895] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.761081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.761267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.761407] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 762.795753] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1031 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.795903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 762.795976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 762.796206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 762.796344] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 762.809716] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 762.809916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.010440] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 763.010767] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=7], Jobs=0 [ 763.010839] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGH for action security_group_rules [ 763.010997] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGH for action security_group_rules [ 763.011103] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGH for action security_group_rules [ 763.011207] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 763.011299] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGH for action security_group_rules [ 763.011391] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGH for action security_group_rules [ 763.011483] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 763.011963] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.012132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.012219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.012436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.012541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.012781] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.012941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.013047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.013301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.013455] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.014457] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.014578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.014657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.014823] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.014911] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.015087] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.015181] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.015243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.015408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.015502] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.016552] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.016648] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.016710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.016891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.016949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.017098] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.017193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.017253] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.017441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.017479] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.019195] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.019321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.019368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.019519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.019592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.019728] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.019814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.019872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.020018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.020086] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.021453] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.021588] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.021641] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.021789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.021900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.021992] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.022122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.022157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.022290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.022357] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.023205] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.023306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.023371] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.023518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.023592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.023726] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.023814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.023871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.024020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.024082] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.032836] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.032958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.033021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.033201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.033279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.033426] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.033516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.033574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.033721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.033856] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.033942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.034000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.034138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.034213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.034288] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.034367] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.049217] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.049376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.049442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.049625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.049712] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.049862] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.049959] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.050044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.050225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.050366] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.050457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.050532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.050700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.050777] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.050854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.050934] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.052505] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.052609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.052669] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.052818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.052890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.053030] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.053117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.053175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.053310] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.053439] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.053525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.053581] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.053710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.053781] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.053858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.053997] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.054081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.054138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.054269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.054334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.054463] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.054546] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.054635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.054770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.054896] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.054980] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.055034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.055163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.055229] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.055302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.055378] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.056152] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.056248] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.056311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.056454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.056524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.056713] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.056787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.056827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.056933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.057062] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.057148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.057205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.057336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.057407] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.057484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.057568] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.070655] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.073702] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.073835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.073901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.074102] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.074187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.074336] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.074436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.074497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.074701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.074847] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.074939] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.075002] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.075138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.075218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.075299] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.075384] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.076831] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.076943] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.077007] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.077158] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.077237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.077379] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.077540] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.077763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.077857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.078000] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.078090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.078159] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.078287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.078364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.078510] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.078603] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.079456] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 916dc4e3-1bc8-4ba5-b319-d9d0dee54564: rpc.has_security_group_logging(os_id): False [ 763.093522] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1266a9f5-7050-4473-ad65-329e9724ea7d: rpc.has_security_group_logging(os_id): False [ 763.094991] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.095126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.095197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.095390] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.095475] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.095624] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.095718] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.095777] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.095924] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.096078] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.096181] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.096226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.096363] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.096442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.096522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.096606] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.097322] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.098634] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.098753] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.098817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.098960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.118076] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.118197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.120763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.121118] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.121227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.121227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.121541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.121541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.121696] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.121802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.121864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.122018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.122091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.122291] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.122381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.122418] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.122537] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.122608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.122685] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 is going to be updated. [ 763.123772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.123926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.125719] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9efe5fcd-faf9-44dd-ac10-abd106d2dc72: rpc.has_security_group_logging(os_id): False [ 763.128372] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.128484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.128549] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.128708] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.128785] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.128933] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.129020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.129086] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.129219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.129349] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.129434] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.129493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.129635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.129822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.129901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.130048] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.130145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.130192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.130326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.130394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.130526] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.130728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.130728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.130835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.130965] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.131062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.131107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.131231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.131300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.131374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.131458] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.132295] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.132416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.132469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.132605] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.132677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.132817] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.132904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.133019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.133095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.133225] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.133316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.133376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.133538] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.133628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.133731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.133838] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.133923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.133987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.134114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.134190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.134312] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.134396] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.134452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.134663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.134798] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.134887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.134948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.135076] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.135148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.135221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.135300] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.137950] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.139564] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5233168b-5f93-4bb0-bac2-dd279d965d46: rpc.has_security_group_logging(os_id): False [ 763.150601] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.150940] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.151062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.151126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.151320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.151403] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.151491] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1266a9f5-7050-4473-ad65-329e9724ea7d is going to be updated. [ 763.154283] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5573ccf-d866-40ac-9bb4-1fa04e91ef9c: rpc.has_security_group_logging(os_id): False [ 763.155790] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 905dd5f8-1bc0-4560-8294-1733c7eaf6f4: rpc.has_security_group_logging(os_id): False [ 763.160452] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.160623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.160668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.160876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.166393] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.166522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.185720] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.185869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.186744] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.186836] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.193893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.194187] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.194285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.194353] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.194550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.194646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.194886] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 is going to be updated. [ 763.196164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.196350] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.200573] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.200782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.209149] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.209272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.227325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.227597] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.227724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.227792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.227990] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.228096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.228294] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.228394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.228469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.228645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.228725] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.228918] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.229000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.229063] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.229206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.229285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.229378] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 763.230510] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.230748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.276702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.277027] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.277133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.277198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.277396] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.277483] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.277578] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 is going to be updated. [ 763.278750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.278942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.279146] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.280215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.280399] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.280547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.282372] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.282495] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.282533] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.282696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.282825] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.283694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.283859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.307987] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 in Status: IN_PROGRESS for 2s [ 763.310215] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 in Status: IN_PROGRESS for 2s [ 763.322699] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1266a9f5-7050-4473-ad65-329e9724ea7d in Status: IN_PROGRESS for 2s [ 763.326580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.326868] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.326994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.327060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.327266] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.327350] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.327562] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.327663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.327785] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.327873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.327947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.328174] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.328271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.328325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.328489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.328619] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.328684] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c is going to be updated. [ 763.395233] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.395382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.395457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.395665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.395811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.426404] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 763.437236] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.437388] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.437458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.437670] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.437822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.455930] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 in Status: IN_PROGRESS for 2s [ 763.458313] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.458467] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 763.458551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 763.458776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 763.458916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 763.482868] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c in Status: IN_PROGRESS for 2s [ 765.326774] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 in Status: SUCCESS [ 765.327197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.327812] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 in Status: SUCCESS [ 765.327970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.335330] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1266a9f5-7050-4473-ad65-329e9724ea7d in Status: SUCCESS [ 765.335500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.439073] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 765.439298] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.469994] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 in Status: SUCCESS [ 765.470219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 765.494971] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c in Status: SUCCESS [ 765.495192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 768.013061] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 768.013314] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 773.015149] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 773.015149] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 778.016424] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 778.016787] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 783.017519] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 783.017827] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 783.641053] env[61817]: INFO networking_nsxv3.common.synchronization [req-fc0b63fe-e867-4f45-989b-37a738a62569 req-a279c8e6-6a26-4c21-b4de-5496cb54b756 tempest-InstanceActionsTestJSON-555491356 tempest-InstanceActionsTestJSON-555491356-project-member] Enqueued Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGHEST for action security_group_members [ 783.641579] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGHEST for action security_group_members [ 783.641941] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.642070] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 783.642138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 783.642332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 783.642417] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 783.642570] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.642716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 783.642806] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 783.646926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 783.646926] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.646926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 783.646926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 783.646926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 783.646926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 783.646926] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.652995] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.653160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 783.653219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 783.653403] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 783.653484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 783.653659] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.653748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 783.653806] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 783.653956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 783.654028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 783.654106] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 already deleted. [ 783.654257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.120037] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.120037] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.120037] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.120037] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.120037] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.120037] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.120037] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.120037] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.120037] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.120779] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.120779] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.120779] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.120779] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.120779] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.120779] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.120779] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.120779] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.121053] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.121053] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.121113] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.121351] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-ef53aedf-e22e-47ae-9876-63e447109deb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.121502] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-ef53aedf-e22e-47ae-9876-63e447109deb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.121610] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-ef53aedf-e22e-47ae-9876-63e447109deb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.121844] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-ef53aedf-e22e-47ae-9876-63e447109deb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.121980] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef53aedf-e22e-47ae-9876-63e447109deb',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.136883] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.137082] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.137203] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.137453] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.137593] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.137765] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port ef53aedf-e22e-47ae-9876-63e447109deb not found, creating... [ 784.138044] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.138173] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.138270] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.138518] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.138673] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.138965] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.139118] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.139235] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.139443] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.139579] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.139720] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: ef53aedf-e22e-47ae-9876-63e447109deb is going to be created. [ 784.162795] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.163029] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.163105] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.163367] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.163592] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.164032] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-ef53aedf-e22e-47ae-9876-63e447109deb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.390178] env[61817]: INFO networking_nsxv3.common.synchronization [req-fc0b63fe-e867-4f45-989b-37a738a62569 req-23c0d2e9-a8ba-40cf-b752-480e1740bdf7 service neutron] Enqueued Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGHEST for action security_group_rules [ 784.390320] env[61817]: INFO networking_nsxv3.common.synchronization [req-fc0b63fe-e867-4f45-989b-37a738a62569 req-23c0d2e9-a8ba-40cf-b752-480e1740bdf7 service neutron] Enqueued Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGHEST for action security_group_members [ 784.390458] env[61817]: INFO networking_nsxv3.common.synchronization [req-fc0b63fe-e867-4f45-989b-37a738a62569 req-23c0d2e9-a8ba-40cf-b752-480e1740bdf7 service neutron] Enqueued Resource ID: ef53aedf-e22e-47ae-9876-63e447109deb with Priority: HIGHEST for action port [ 784.390973] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGHEST for action security_group_rules [ 784.391106] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGHEST for action security_group_members [ 784.391205] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef53aedf-e22e-47ae-9876-63e447109deb with Priority: HIGHEST for action port [ 784.391484] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.391679] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.391765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.391973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.392090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.392256] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.392402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.392500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.392784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.392883] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.393722] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.393820] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.394024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.394203] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.394287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.394471] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.394528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.394586] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.394732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.394866] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.394957] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.395019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.395156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.395235] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.395321] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.396103] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.396213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.396279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.396429] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.396505] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.396662] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef53aedf-e22e-47ae-9876-63e447109deb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.396721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef53aedf-e22e-47ae-9876-63e447109deb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.396783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef53aedf-e22e-47ae-9876-63e447109deb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.396923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef53aedf-e22e-47ae-9876-63e447109deb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.396994] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef53aedf-e22e-47ae-9876-63e447109deb',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.416181] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.436569] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.438711] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.438805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.438856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.439063] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.439147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.439322] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.439419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.439551] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef53aedf-e22e-47ae-9876-63e447109deb with status ACTIVE [ 784.439707] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.439868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.439935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.440116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.440197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.440355] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.440442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.440501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.440723] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.440797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.446250] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.446380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.446445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.446621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.446702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.446790] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 is going to be created. [ 784.497586] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.497812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.497885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.498102] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.498330] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.510689] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 in Status: UNINITIALIZED for 2s [ 784.983340] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.983340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 784.983340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 784.983340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 784.983340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 784.983340] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef53aedf-e22e-47ae-9876-63e447109deb is going to be updated. [ 785.010078] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.010078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 785.010078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 785.010078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 785.010078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 785.010078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef53aedf-e22e-47ae-9876-63e447109deb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.521609] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 in Status: SUCCESS [ 786.521609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.521609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.522057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.522057] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.522156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.522195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.522324] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.522411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.522497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.522586] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.535222] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.535445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.535445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.535622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.535706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.535865] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.535980] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.536063] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.536217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.536359] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.536454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.536512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.536652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.536731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.536815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.536964] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.537055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.537113] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.537250] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.537322] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.537459] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.537549] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.537610] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.537750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.537885] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.537974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.538028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.538164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.538237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.538316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.538403] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.545318] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62ddbcee-1db4-4515-8d5b-c25d44008cc0: rpc.has_security_group_logging(os_id): False [ 786.563427] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.563606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.563671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.563824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.563915] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.564143] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.564250] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.564337] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.564499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.564578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.564754] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.564850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.564918] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.565051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.565130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.565299] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.565392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.565445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.565582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.565657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.565742] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 is going to be created. [ 786.627399] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.627566] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 786.627635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 786.627840] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 786.628048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 786.642987] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 in Status: IN_PROGRESS for 2s [ 788.659503] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 in Status: SUCCESS [ 788.659776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 789.392792] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 789.392792] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 791.766095] env[61817]: INFO networking_nsxv3.common.synchronization [None req-018b9e68-74a7-4844-85f5-c24ace61d508 None None] Enqueued Resource ID: 89d84310-204a-4479-9cca-1d82dc1cca5c with Priority: HIGHEST for action port [ 791.766095] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89d84310-204a-4479-9cca-1d82dc1cca5c with Priority: HIGHEST for action port [ 791.766095] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.766095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 791.766095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 791.766095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 791.766095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 791.766607] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-89d84310-204a-4479-9cca-1d82dc1cca5c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.766607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89d84310-204a-4479-9cca-1d82dc1cca5c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 791.766607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89d84310-204a-4479-9cca-1d82dc1cca5c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 791.766607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89d84310-204a-4479-9cca-1d82dc1cca5c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 791.766607] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89d84310-204a-4479-9cca-1d82dc1cca5c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.812491] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89d84310-204a-4479-9cca-1d82dc1cca5c [ 791.812738] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.812847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 791.812905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 791.813148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 791.813238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 791.813328] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89d84310-204a-4479-9cca-1d82dc1cca5c already deleted. [ 791.813402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89d84310-204a-4479-9cca-1d82dc1cca5c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 793.754001] env[61817]: INFO networking_nsxv3.common.synchronization [None req-b32a3cfe-20f0-42e5-b226-b2ced5ff0770 None None] Enqueued Resource ID: 5a5d6980-3cc2-42c9-93e0-374fff6fcdcf with Priority: HIGHEST for action port [ 793.754738] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a5d6980-3cc2-42c9-93e0-374fff6fcdcf with Priority: HIGHEST for action port [ 793.754840] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.755062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 793.755062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 793.755203] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 793.755292] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 793.755442] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a5d6980-3cc2-42c9-93e0-374fff6fcdcf taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.755539] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a5d6980-3cc2-42c9-93e0-374fff6fcdcf" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 793.755603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a5d6980-3cc2-42c9-93e0-374fff6fcdcf" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 793.755809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a5d6980-3cc2-42c9-93e0-374fff6fcdcf" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 793.755981] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a5d6980-3cc2-42c9-93e0-374fff6fcdcf',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.769191] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a5d6980-3cc2-42c9-93e0-374fff6fcdcf [ 793.769191] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.769191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 793.769191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 793.769191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 793.769191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 793.769191] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a5d6980-3cc2-42c9-93e0-374fff6fcdcf already deleted. [ 793.769191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a5d6980-3cc2-42c9-93e0-374fff6fcdcf" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 798.755155] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 798.755511] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 803.760401] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 803.760680] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 808.762098] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 808.762374] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 813.762700] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 813.762986] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 816.805935] env[61817]: INFO networking_nsxv3.common.synchronization [None req-d709aaba-983b-4c42-9d82-b0a9f1ee749e None None] Enqueued Resource ID: bec6e28d-3eb0-4f7e-89bd-2cbc8f659e6c with Priority: HIGHEST for action port [ 816.806438] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec6e28d-3eb0-4f7e-89bd-2cbc8f659e6c with Priority: HIGHEST for action port [ 816.806735] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.806856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.806920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.807116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.807195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.807341] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-bec6e28d-3eb0-4f7e-89bd-2cbc8f659e6c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.807431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bec6e28d-3eb0-4f7e-89bd-2cbc8f659e6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.807490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bec6e28d-3eb0-4f7e-89bd-2cbc8f659e6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.807686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bec6e28d-3eb0-4f7e-89bd-2cbc8f659e6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.807753] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bec6e28d-3eb0-4f7e-89bd-2cbc8f659e6c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.819177] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bec6e28d-3eb0-4f7e-89bd-2cbc8f659e6c [ 816.819373] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.819495] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 816.819564] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 816.819746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 816.819835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 816.819927] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bec6e28d-3eb0-4f7e-89bd-2cbc8f659e6c already deleted. [ 816.820141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bec6e28d-3eb0-4f7e-89bd-2cbc8f659e6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.684125] env[61817]: INFO networking_nsxv3.common.synchronization [None req-0e1eae1a-5144-4513-b39d-613c1ca113ee None None] Enqueued Resource ID: 3b119867-e7d1-4faa-8df8-b329acb0dd13 with Priority: HIGHEST for action port [ 819.684410] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b119867-e7d1-4faa-8df8-b329acb0dd13 with Priority: HIGHEST for action port [ 819.684964] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.685116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.685171] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.685355] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.685437] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.685582] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b119867-e7d1-4faa-8df8-b329acb0dd13 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.685680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b119867-e7d1-4faa-8df8-b329acb0dd13" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.685731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b119867-e7d1-4faa-8df8-b329acb0dd13" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.685916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b119867-e7d1-4faa-8df8-b329acb0dd13" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.685992] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b119867-e7d1-4faa-8df8-b329acb0dd13',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.708788] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b119867-e7d1-4faa-8df8-b329acb0dd13 [ 819.709043] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.709180] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 819.709248] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 819.709447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 819.709531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 819.709631] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b119867-e7d1-4faa-8df8-b329acb0dd13 already deleted. [ 819.709710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b119867-e7d1-4faa-8df8-b329acb0dd13" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 821.108041] env[61817]: INFO networking_nsxv3.common.synchronization [None req-e836e01b-8cb2-4d4d-9e36-0a92bef1194f None None] Enqueued Resource ID: af25c95f-3ff9-467d-9648-9e7f8dedb9d2 with Priority: HIGHEST for action port [ 821.108041] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af25c95f-3ff9-467d-9648-9e7f8dedb9d2 with Priority: HIGHEST for action port [ 821.108041] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.108041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 821.108041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 821.108041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 821.108041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 821.108041] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-af25c95f-3ff9-467d-9648-9e7f8dedb9d2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.108041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af25c95f-3ff9-467d-9648-9e7f8dedb9d2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 821.108041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af25c95f-3ff9-467d-9648-9e7f8dedb9d2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 821.108041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af25c95f-3ff9-467d-9648-9e7f8dedb9d2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 821.108041] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af25c95f-3ff9-467d-9648-9e7f8dedb9d2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.115969] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af25c95f-3ff9-467d-9648-9e7f8dedb9d2 [ 821.116193] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.116323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 821.116391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 821.116580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 821.116680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 821.116756] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af25c95f-3ff9-467d-9648-9e7f8dedb9d2 already deleted. [ 821.116826] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af25c95f-3ff9-467d-9648-9e7f8dedb9d2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 823.701941] env[61817]: INFO networking_nsxv3.common.synchronization [None req-f5b547a6-ee48-4db0-9cff-51af3dccfd81 None None] Enqueued Resource ID: f729af54-ffdc-472a-9256-ced56754d0a9 with Priority: HIGHEST for action port [ 823.702230] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f729af54-ffdc-472a-9256-ced56754d0a9 with Priority: HIGHEST for action port [ 823.702691] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.702809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 823.702875] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 823.703105] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 823.703194] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 823.703347] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f729af54-ffdc-472a-9256-ced56754d0a9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.703462] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f729af54-ffdc-472a-9256-ced56754d0a9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 823.703581] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f729af54-ffdc-472a-9256-ced56754d0a9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 823.703792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f729af54-ffdc-472a-9256-ced56754d0a9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 823.703887] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f729af54-ffdc-472a-9256-ced56754d0a9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.730234] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f729af54-ffdc-472a-9256-ced56754d0a9 [ 823.730234] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.730234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 823.730234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 823.730234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 823.730234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 823.730234] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f729af54-ffdc-472a-9256-ced56754d0a9 already deleted. [ 823.730234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f729af54-ffdc-472a-9256-ced56754d0a9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 826.107240] env[61817]: INFO networking_nsxv3.common.synchronization [None req-918ebfd1-a951-4442-bcfd-b4c71349401d None None] Enqueued Resource ID: 9dd2a668-9be4-41fd-a1f5-0b539f9e2598 with Priority: HIGHEST for action port [ 826.107521] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd2a668-9be4-41fd-a1f5-0b539f9e2598 with Priority: HIGHEST for action port [ 826.112068] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.112068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 826.112068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 826.112068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 826.112068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 826.112068] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dd2a668-9be4-41fd-a1f5-0b539f9e2598 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.112068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dd2a668-9be4-41fd-a1f5-0b539f9e2598" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 826.112068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dd2a668-9be4-41fd-a1f5-0b539f9e2598" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 826.112068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dd2a668-9be4-41fd-a1f5-0b539f9e2598" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 826.112068] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dd2a668-9be4-41fd-a1f5-0b539f9e2598',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.366687] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dd2a668-9be4-41fd-a1f5-0b539f9e2598 [ 826.366919] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.367044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 826.367110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 826.367312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 826.367404] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 826.367483] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dd2a668-9be4-41fd-a1f5-0b539f9e2598 already deleted. [ 826.367585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dd2a668-9be4-41fd-a1f5-0b539f9e2598" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 826.405675] env[61817]: INFO networking_nsxv3.common.synchronization [None req-fff8b9ae-d423-4c1c-a4e8-a2e66217b7bd None None] Enqueued Resource ID: c7f7b1c2-7b3b-4174-9e2d-3698f0e6c401 with Priority: HIGHEST for action port [ 826.405992] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f7b1c2-7b3b-4174-9e2d-3698f0e6c401 with Priority: HIGHEST for action port [ 826.406565] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.406700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 826.406792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 826.407006] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 826.407086] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 826.407239] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7f7b1c2-7b3b-4174-9e2d-3698f0e6c401 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.407332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7f7b1c2-7b3b-4174-9e2d-3698f0e6c401" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 826.407392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7f7b1c2-7b3b-4174-9e2d-3698f0e6c401" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 826.407569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7f7b1c2-7b3b-4174-9e2d-3698f0e6c401" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 826.407910] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7f7b1c2-7b3b-4174-9e2d-3698f0e6c401',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.444597] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7f7b1c2-7b3b-4174-9e2d-3698f0e6c401 [ 826.445001] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.445001] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 826.445121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 826.445224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 826.445309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 826.445396] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7f7b1c2-7b3b-4174-9e2d-3698f0e6c401 already deleted. [ 826.445472] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7f7b1c2-7b3b-4174-9e2d-3698f0e6c401" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 829.502468] env[61817]: INFO networking_nsxv3.common.synchronization [None req-942574d1-b639-43b5-8754-15f78f614263 None None] Enqueued Resource ID: def0115c-23ca-46f8-9d59-45802bd7e315 with Priority: HIGHEST for action port [ 829.502748] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def0115c-23ca-46f8-9d59-45802bd7e315 with Priority: HIGHEST for action port [ 829.503337] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.503469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 829.503528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 829.503730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 829.503900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 829.504085] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-def0115c-23ca-46f8-9d59-45802bd7e315 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.504182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-def0115c-23ca-46f8-9d59-45802bd7e315" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 829.504382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-def0115c-23ca-46f8-9d59-45802bd7e315" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 829.504599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-def0115c-23ca-46f8-9d59-45802bd7e315" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 829.504682] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('def0115c-23ca-46f8-9d59-45802bd7e315',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.544868] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port def0115c-23ca-46f8-9d59-45802bd7e315 [ 829.545096] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.545231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 829.545300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 829.545502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 829.545592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 829.545682] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:def0115c-23ca-46f8-9d59-45802bd7e315 already deleted. [ 829.545834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-def0115c-23ca-46f8-9d59-45802bd7e315" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 829.565168] env[61817]: INFO networking_nsxv3.common.synchronization [None req-ad34c686-b123-49df-91a2-d99c24648be8 None None] Enqueued Resource ID: 611f3a0c-68c6-4f90-8394-d368eff13ccb with Priority: HIGHEST for action port [ 829.565645] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 611f3a0c-68c6-4f90-8394-d368eff13ccb with Priority: HIGHEST for action port [ 829.565957] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.566080] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 829.566147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 829.566343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 829.566430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 829.566578] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-611f3a0c-68c6-4f90-8394-d368eff13ccb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.566674] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-611f3a0c-68c6-4f90-8394-d368eff13ccb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 829.566734] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-611f3a0c-68c6-4f90-8394-d368eff13ccb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 829.567005] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-611f3a0c-68c6-4f90-8394-d368eff13ccb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 829.567089] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('611f3a0c-68c6-4f90-8394-d368eff13ccb',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.583209] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 611f3a0c-68c6-4f90-8394-d368eff13ccb [ 829.583497] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.583665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 829.583768] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 829.584031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 829.584147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 829.584270] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:611f3a0c-68c6-4f90-8394-d368eff13ccb already deleted. [ 829.584380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-611f3a0c-68c6-4f90-8394-d368eff13ccb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 834.212118] env[61817]: INFO networking_nsxv3.common.synchronization [req-1a0eceb3-0800-4c89-8366-abc4ca18cc0e req-8f5a9ef7-655c-4208-9eb3-57d8d0bf91b1 tempest-AttachVolumeNegativeTest-329748670 tempest-AttachVolumeNegativeTest-329748670-project-member] Enqueued Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGHEST for action security_group_members [ 834.212955] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGHEST for action security_group_members [ 834.213020] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.213167] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 834.213244] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 834.213553] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 834.213553] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 834.213723] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.213838] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 834.213869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 834.214704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 834.214899] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.215008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 834.215069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 834.215251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 834.215343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 834.215447] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.225202] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.225343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 834.225406] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 834.225598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 834.225681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 834.225857] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.225955] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 834.226009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 834.226143] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 834.226216] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 834.226292] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d193cbd-452d-400d-b88e-58fc27978848 already deleted. [ 834.226367] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.034130] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.034334] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.034457] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.034727] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.034869] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.035119] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-324 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.035289] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-324" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.035475] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-324" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.035656] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-324" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.035898] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.036061] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.036189] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.036395] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.036534] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.036983] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 871 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.037150] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.037270] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.037546] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.037677] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.037815] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: Segment with ID: nsx-vlan-transportzone-324 is going to be created. [ 835.069467] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 871 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.069752] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.069882] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.070142] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.070358] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.070580] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-324" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.070939] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.071042] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.071154] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.071372] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.071499] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.071824] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-c26c1295-f169-4877-b05c-c78c678b1481 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.071935] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-c26c1295-f169-4877-b05c-c78c678b1481" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.071999] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-c26c1295-f169-4877-b05c-c78c678b1481" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.072421] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-c26c1295-f169-4877-b05c-c78c678b1481" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.072421] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c26c1295-f169-4877-b05c-c78c678b1481',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.096582] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.096799] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.096927] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.097190] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.097338] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.097569] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port c26c1295-f169-4877-b05c-c78c678b1481 not found, creating... [ 835.097762] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.097922] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.098038] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.098271] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.098380] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.098720] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.098883] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.098999] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.099206] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.099337] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.099473] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: c26c1295-f169-4877-b05c-c78c678b1481 is going to be created. [ 835.141302] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.141302] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.141302] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.141302] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.141302] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.141302] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-c26c1295-f169-4877-b05c-c78c678b1481" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.876158] env[61817]: INFO networking_nsxv3.common.synchronization [req-1a0eceb3-0800-4c89-8366-abc4ca18cc0e req-af93e08d-1b9b-4b93-a823-e18e534d59a4 service neutron] Enqueued Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGHEST for action security_group_rules [ 835.876458] env[61817]: INFO networking_nsxv3.common.synchronization [req-1a0eceb3-0800-4c89-8366-abc4ca18cc0e req-af93e08d-1b9b-4b93-a823-e18e534d59a4 service neutron] Enqueued Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGHEST for action security_group_members [ 835.876557] env[61817]: INFO networking_nsxv3.common.synchronization [req-1a0eceb3-0800-4c89-8366-abc4ca18cc0e req-af93e08d-1b9b-4b93-a823-e18e534d59a4 service neutron] Enqueued Resource ID: c26c1295-f169-4877-b05c-c78c678b1481 with Priority: HIGHEST for action port [ 835.877178] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGHEST for action security_group_rules [ 835.877383] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGHEST for action security_group_members [ 835.877555] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26c1295-f169-4877-b05c-c78c678b1481 with Priority: HIGHEST for action port [ 835.877977] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.878167] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.878278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.878643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.878725] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.878962] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.879054] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.879097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.879242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.879318] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.880604] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.880712] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.880864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.881366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.881366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.881366] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.881366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.881366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.881569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.881569] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.881688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.881688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.881904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.881960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.882012] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.882836] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.882940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.883003] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.883149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.883221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.883457] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-c26c1295-f169-4877-b05c-c78c678b1481 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.883457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c26c1295-f169-4877-b05c-c78c678b1481" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.883760] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c26c1295-f169-4877-b05c-c78c678b1481" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.883760] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c26c1295-f169-4877-b05c-c78c678b1481" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.883760] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c26c1295-f169-4877-b05c-c78c678b1481',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.908921] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.922842] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.923064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.923139] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.923739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.923900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.924580] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.924766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.931110] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.932664] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c26c1295-f169-4877-b05c-c78c678b1481 with status ACTIVE [ 835.933021] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.933233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.933342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.933596] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.933751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.933968] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.934139] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.934271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.934659] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.934659] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.941007] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.941253] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 835.941467] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 835.941698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 835.941814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 835.941953] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d193cbd-452d-400d-b88e-58fc27978848 is going to be created. [ 836.000246] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.000502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 836.000502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 836.000735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 836.000897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 836.014405] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d193cbd-452d-400d-b88e-58fc27978848 in Status: UNINITIALIZED for 2s [ 836.443549] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.443847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 836.443847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 836.444668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 836.444668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 836.444668] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c26c1295-f169-4877-b05c-c78c678b1481 is going to be updated. [ 836.475016] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.475177] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 836.475270] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 836.475450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 836.475622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 836.475773] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c26c1295-f169-4877-b05c-c78c678b1481" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.024367] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d193cbd-452d-400d-b88e-58fc27978848 in Status: SUCCESS [ 838.024669] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.024758] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.024967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.025160] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.025282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.025349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.025497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.025805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.025805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.025805] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.036982] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.043241] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d193cbd-452d-400d-b88e-58fc27978848: rpc.has_security_group_logging(os_id): False [ 838.061709] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.061902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.061902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.062125] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.062220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.062462] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.062603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.062648] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.062776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.062855] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.062942] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d193cbd-452d-400d-b88e-58fc27978848 is going to be created. [ 838.145072] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.145253] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.145441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.145577] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.145676] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.161466] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d193cbd-452d-400d-b88e-58fc27978848 in Status: IN_PROGRESS for 2s [ 838.780900] env[61817]: INFO networking_nsxv3.common.synchronization [None req-f6e749bc-4987-45ce-814b-9614d638261a None None] Enqueued Resource ID: f05da2bf-08f1-4bdb-9b50-1b89c5ec9f00 with Priority: HIGHEST for action port [ 838.781451] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f05da2bf-08f1-4bdb-9b50-1b89c5ec9f00 with Priority: HIGHEST for action port [ 838.781876] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.782009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.782078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.782279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.782366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.782548] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f05da2bf-08f1-4bdb-9b50-1b89c5ec9f00 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.782673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f05da2bf-08f1-4bdb-9b50-1b89c5ec9f00" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.782745] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f05da2bf-08f1-4bdb-9b50-1b89c5ec9f00" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.783270] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f05da2bf-08f1-4bdb-9b50-1b89c5ec9f00" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.783270] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f05da2bf-08f1-4bdb-9b50-1b89c5ec9f00',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.792579] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f05da2bf-08f1-4bdb-9b50-1b89c5ec9f00 [ 838.792772] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.792901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 838.792973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 838.793156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 838.793247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 838.793337] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f05da2bf-08f1-4bdb-9b50-1b89c5ec9f00 already deleted. [ 838.793418] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f05da2bf-08f1-4bdb-9b50-1b89c5ec9f00" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 840.175584] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d193cbd-452d-400d-b88e-58fc27978848 in Status: SUCCESS [ 840.175861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 840.326661] env[61817]: INFO networking_nsxv3.common.synchronization [None req-70247da1-29f9-47cb-9b5b-8ac078efa931 None None] Enqueued Resource ID: 3e1cb761-05e2-4050-ad02-8a7f42b1a14e with Priority: HIGHEST for action port [ 840.326956] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e1cb761-05e2-4050-ad02-8a7f42b1a14e with Priority: HIGHEST for action port [ 840.327562] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.327700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 840.327769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 840.327973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 840.328077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 840.328228] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e1cb761-05e2-4050-ad02-8a7f42b1a14e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.328332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e1cb761-05e2-4050-ad02-8a7f42b1a14e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 840.328396] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e1cb761-05e2-4050-ad02-8a7f42b1a14e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 840.328715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e1cb761-05e2-4050-ad02-8a7f42b1a14e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 840.328801] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e1cb761-05e2-4050-ad02-8a7f42b1a14e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.344214] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e1cb761-05e2-4050-ad02-8a7f42b1a14e [ 840.344375] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.344484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 840.344616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 840.344882] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 840.344977] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 840.345089] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e1cb761-05e2-4050-ad02-8a7f42b1a14e already deleted. [ 840.345228] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e1cb761-05e2-4050-ad02-8a7f42b1a14e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 842.312736] env[61817]: INFO networking_nsxv3.common.synchronization [None req-a2255ca5-7b11-4ad0-b3e2-2832329cdfc1 None None] Enqueued Resource ID: 436b3498-c468-4433-8800-2148f97627c0 with Priority: HIGHEST for action port [ 842.313459] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 436b3498-c468-4433-8800-2148f97627c0 with Priority: HIGHEST for action port [ 842.313821] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.313947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 842.314011] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 842.314212] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 842.314289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 842.314462] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-436b3498-c468-4433-8800-2148f97627c0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.314580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-436b3498-c468-4433-8800-2148f97627c0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 842.314657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-436b3498-c468-4433-8800-2148f97627c0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 842.314895] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-436b3498-c468-4433-8800-2148f97627c0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 842.314975] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('436b3498-c468-4433-8800-2148f97627c0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.327427] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 436b3498-c468-4433-8800-2148f97627c0 [ 842.327730] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.327897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 842.327971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 842.329088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 842.329088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 842.329088] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:436b3498-c468-4433-8800-2148f97627c0 already deleted. [ 842.329088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-436b3498-c468-4433-8800-2148f97627c0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 842.742260] env[61817]: INFO networking_nsxv3.common.synchronization [None req-a066e645-f31c-4a40-bb70-8b909d30cfd7 tempest-AttachInterfacesUnderV243Test-1999617247 tempest-AttachInterfacesUnderV243Test-1999617247-project-member] Enqueued Resource ID: 6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8 with Priority: HIGHEST for action security_group_rules [ 842.742793] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8 with Priority: HIGHEST for action security_group_rules [ 842.743107] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.743233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 842.743302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 842.743504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 842.743588] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 842.743742] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.743833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 842.743883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 842.744094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 842.744194] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.800800] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.800988] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 842.801074] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 842.801249] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 842.801364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 842.801704] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8 already deleted. [ 842.801704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 842.850926] env[61817]: INFO networking_nsxv3.common.synchronization [None req-429ce252-95ca-4eac-994d-1889ecc9f7b4 tempest-AttachInterfacesUnderV243Test-1999617247 tempest-AttachInterfacesUnderV243Test-1999617247-project-member] Enqueued Resource ID: 6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8 with Priority: HIGHEST for action security_group_rules [ 842.850926] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8 with Priority: HIGHEST for action security_group_rules [ 842.851495] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.851592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 842.851592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 842.851834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 842.852280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 842.852280] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.852280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 842.852280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 842.852459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 842.852491] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.906355] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.906470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 842.906575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 842.906753] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 842.906849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 842.906940] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8 already deleted. [ 842.907017] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ccc8b7c-196b-4adf-8fd4-9684fe4d79d8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 843.336595] env[61817]: INFO networking_nsxv3.common.synchronization [None req-340dd836-9a1d-48da-8d90-91145b2ab639 None None] Enqueued Resource ID: c770294f-74f3-47a8-9445-446bfb8f1d29 with Priority: HIGHEST for action port [ 843.336595] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c770294f-74f3-47a8-9445-446bfb8f1d29 with Priority: HIGHEST for action port [ 843.336595] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.336595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 843.336595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 843.336595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 843.336595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 843.336595] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-c770294f-74f3-47a8-9445-446bfb8f1d29 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.336595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c770294f-74f3-47a8-9445-446bfb8f1d29" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 843.336595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c770294f-74f3-47a8-9445-446bfb8f1d29" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 843.336595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c770294f-74f3-47a8-9445-446bfb8f1d29" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 843.336595] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c770294f-74f3-47a8-9445-446bfb8f1d29',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.364929] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c770294f-74f3-47a8-9445-446bfb8f1d29 [ 843.365145] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.365271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 843.365335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 843.365528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 843.365612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 843.365697] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c770294f-74f3-47a8-9445-446bfb8f1d29 already deleted. [ 843.365772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c770294f-74f3-47a8-9445-446bfb8f1d29" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 846.167611] env[61817]: INFO networking_nsxv3.common.synchronization [None req-10f93b39-dcb7-420c-856c-71fdbb46413a tempest-TaggedBootDevicesTest_v242-294738673 tempest-TaggedBootDevicesTest_v242-294738673-project-member] Enqueued Resource ID: bfa1482d-8383-460c-8989-a3332cbb46d0 with Priority: HIGHEST for action security_group_members [ 846.168240] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfa1482d-8383-460c-8989-a3332cbb46d0 with Priority: HIGHEST for action security_group_members [ 846.168555] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.168704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 846.168770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 846.169014] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 846.169056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 846.169232] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfa1482d-8383-460c-8989-a3332cbb46d0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.169328] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 846.169389] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 846.169594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 846.169728] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.169817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 846.169876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 846.170017] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 846.170130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 846.170180] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfa1482d-8383-460c-8989-a3332cbb46d0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.183224] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.183383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 846.183435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 846.183654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 846.183749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 846.183936] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.184048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 846.184112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 846.184264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 846.184343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 846.184430] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfa1482d-8383-460c-8989-a3332cbb46d0 already deleted. [ 846.184847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 846.547787] env[61817]: INFO networking_nsxv3.common.synchronization [None req-c4eb0887-46a0-4ea7-98d7-2231269fa295 tempest-TaggedBootDevicesTest_v242-294738673 tempest-TaggedBootDevicesTest_v242-294738673-project-member] Enqueued Resource ID: bfa1482d-8383-460c-8989-a3332cbb46d0 with Priority: HIGHEST for action security_group_members [ 846.548324] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfa1482d-8383-460c-8989-a3332cbb46d0 with Priority: HIGHEST for action security_group_members [ 846.548666] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.548788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 846.548854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 846.549053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 846.549137] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 846.549290] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfa1482d-8383-460c-8989-a3332cbb46d0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.549392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 846.549479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 846.549597] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 846.549734] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.549824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 846.549883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 846.550034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 846.550087] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 846.550173] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfa1482d-8383-460c-8989-a3332cbb46d0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.558533] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.558690] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 846.558734] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 846.558931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 846.559047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 846.559384] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.559384] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 846.559384] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 846.559536] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 846.559536] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 846.559625] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfa1482d-8383-460c-8989-a3332cbb46d0 already deleted. [ 846.559698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 847.664257] env[61817]: INFO networking_nsxv3.common.synchronization [None req-62f4efb7-e1fb-431a-8406-cdb056273fea tempest-TaggedBootDevicesTest_v242-294738673 tempest-TaggedBootDevicesTest_v242-294738673-project-member] Enqueued Resource ID: 53a530e6-8198-498f-83b4-0c7d460fd7c2 with Priority: HIGHEST for action security_group_rules [ 847.664767] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a530e6-8198-498f-83b4-0c7d460fd7c2 with Priority: HIGHEST for action security_group_rules [ 847.665371] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.665491] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 847.665578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 847.665744] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 847.665825] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 847.665969] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53a530e6-8198-498f-83b4-0c7d460fd7c2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.666060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53a530e6-8198-498f-83b4-0c7d460fd7c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 847.666114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53a530e6-8198-498f-83b4-0c7d460fd7c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 847.666309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53a530e6-8198-498f-83b4-0c7d460fd7c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 847.666380] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53a530e6-8198-498f-83b4-0c7d460fd7c2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.702215] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.702215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 847.702215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 847.702215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 847.702215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 847.702215] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53a530e6-8198-498f-83b4-0c7d460fd7c2 already deleted. [ 847.702215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53a530e6-8198-498f-83b4-0c7d460fd7c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 848.066983] env[61817]: INFO networking_nsxv3.common.synchronization [None req-f4e07915-485a-4209-a843-aaca9ffe3832 tempest-TaggedBootDevicesTest_v242-294738673 tempest-TaggedBootDevicesTest_v242-294738673-project-member] Enqueued Resource ID: 53a530e6-8198-498f-83b4-0c7d460fd7c2 with Priority: HIGHEST for action security_group_rules [ 848.066983] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a530e6-8198-498f-83b4-0c7d460fd7c2 with Priority: HIGHEST for action security_group_rules [ 848.066983] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.066983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 848.066983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 848.066983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 848.066983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 848.066983] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53a530e6-8198-498f-83b4-0c7d460fd7c2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.066983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53a530e6-8198-498f-83b4-0c7d460fd7c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 848.066983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53a530e6-8198-498f-83b4-0c7d460fd7c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 848.068021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53a530e6-8198-498f-83b4-0c7d460fd7c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 848.068021] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53a530e6-8198-498f-83b4-0c7d460fd7c2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.106224] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.106224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 848.106224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 848.106224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 848.106224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 848.106224] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53a530e6-8198-498f-83b4-0c7d460fd7c2 already deleted. [ 848.106224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53a530e6-8198-498f-83b4-0c7d460fd7c2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 849.099237] env[61817]: INFO networking_nsxv3.common.synchronization [None req-0c762c3a-2e38-4e98-9d6a-ac8fa7e5be6a None None] Enqueued Resource ID: 5116f6b3-18a9-4e9a-8741-516da20135c9 with Priority: HIGHEST for action port [ 849.099237] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5116f6b3-18a9-4e9a-8741-516da20135c9 with Priority: HIGHEST for action port [ 849.099237] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.099237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 849.099237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 849.099237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 849.099237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 849.099237] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-5116f6b3-18a9-4e9a-8741-516da20135c9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.099237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5116f6b3-18a9-4e9a-8741-516da20135c9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 849.099237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5116f6b3-18a9-4e9a-8741-516da20135c9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 849.099237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5116f6b3-18a9-4e9a-8741-516da20135c9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 849.099237] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5116f6b3-18a9-4e9a-8741-516da20135c9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.107884] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5116f6b3-18a9-4e9a-8741-516da20135c9 [ 849.108107] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.108232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 849.108297] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 849.108498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 849.108611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 849.108736] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5116f6b3-18a9-4e9a-8741-516da20135c9 already deleted. [ 849.108782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5116f6b3-18a9-4e9a-8741-516da20135c9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 851.197156] env[61817]: INFO networking_nsxv3.common.synchronization [None req-c622c2a2-f1a7-46ab-bec9-25cea199ec83 None None] Enqueued Resource ID: 0f1f2291-df7f-4e39-a365-dc55bf70add1 with Priority: HIGHEST for action port [ 851.197446] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f1f2291-df7f-4e39-a365-dc55bf70add1 with Priority: HIGHEST for action port [ 851.197970] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.198097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 851.198164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 851.198359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 851.198447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 851.198603] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f1f2291-df7f-4e39-a365-dc55bf70add1 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.198714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f1f2291-df7f-4e39-a365-dc55bf70add1" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 851.198778] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f1f2291-df7f-4e39-a365-dc55bf70add1" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 851.198987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f1f2291-df7f-4e39-a365-dc55bf70add1" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 851.199059] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f1f2291-df7f-4e39-a365-dc55bf70add1',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.236881] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f1f2291-df7f-4e39-a365-dc55bf70add1 [ 851.237084] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.237215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 851.237284] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 851.237485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 851.237575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 851.237669] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f1f2291-df7f-4e39-a365-dc55bf70add1 already deleted. [ 851.237752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f1f2291-df7f-4e39-a365-dc55bf70add1" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 853.605028] env[61817]: INFO networking_nsxv3.common.synchronization [None req-b6605d94-469c-44e0-95b3-973d36f59334 tempest-AttachVolumeShelveTestJSON-1537042233 tempest-AttachVolumeShelveTestJSON-1537042233-project-member] Enqueued Resource ID: 45632c62-f917-4028-a7ed-c3834051b759 with Priority: HIGHEST for action security_group_rules [ 853.605313] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45632c62-f917-4028-a7ed-c3834051b759 with Priority: HIGHEST for action security_group_rules [ 853.605380] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.605501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 853.605564] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 853.605766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 853.605844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 853.605991] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45632c62-f917-4028-a7ed-c3834051b759 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.606083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45632c62-f917-4028-a7ed-c3834051b759" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 853.606137] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45632c62-f917-4028-a7ed-c3834051b759" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 853.606326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45632c62-f917-4028-a7ed-c3834051b759" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 853.606402] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45632c62-f917-4028-a7ed-c3834051b759',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.637599] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.637746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 853.637806] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 853.638014] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 853.638097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 853.638189] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45632c62-f917-4028-a7ed-c3834051b759 already deleted. [ 853.638267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45632c62-f917-4028-a7ed-c3834051b759" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 853.697656] env[61817]: INFO networking_nsxv3.common.synchronization [None req-5ce4fbe9-fed6-4171-9fa4-aa7f67e83e04 tempest-AttachVolumeShelveTestJSON-1537042233 tempest-AttachVolumeShelveTestJSON-1537042233-project-member] Enqueued Resource ID: 45632c62-f917-4028-a7ed-c3834051b759 with Priority: HIGHEST for action security_group_rules [ 853.698196] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45632c62-f917-4028-a7ed-c3834051b759 with Priority: HIGHEST for action security_group_rules [ 853.698490] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.698656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 853.698726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 853.698929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 853.699010] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 853.699185] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45632c62-f917-4028-a7ed-c3834051b759 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.699282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45632c62-f917-4028-a7ed-c3834051b759" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 853.699341] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45632c62-f917-4028-a7ed-c3834051b759" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 853.699492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45632c62-f917-4028-a7ed-c3834051b759" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 853.699568] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45632c62-f917-4028-a7ed-c3834051b759',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.730928] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.731109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 853.731187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 853.731444] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 853.731553] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 853.731735] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45632c62-f917-4028-a7ed-c3834051b759 already deleted. [ 853.731830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45632c62-f917-4028-a7ed-c3834051b759" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 856.091900] env[61817]: INFO networking_nsxv3.common.synchronization [None req-980d1021-1741-4150-a264-18671c40c452 tempest-AttachInterfacesTestJSON-327680650 tempest-AttachInterfacesTestJSON-327680650-project-member] Enqueued Resource ID: 3d5e99a2-4df8-4714-aa2a-ed3807134262 with Priority: HIGHEST for action security_group_rules [ 856.092422] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d5e99a2-4df8-4714-aa2a-ed3807134262 with Priority: HIGHEST for action security_group_rules [ 856.093019] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.093145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 856.093209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 856.093410] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 856.093497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 856.093652] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d5e99a2-4df8-4714-aa2a-ed3807134262 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.093762] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d5e99a2-4df8-4714-aa2a-ed3807134262" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 856.093815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d5e99a2-4df8-4714-aa2a-ed3807134262" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 856.094024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d5e99a2-4df8-4714-aa2a-ed3807134262" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 856.094106] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d5e99a2-4df8-4714-aa2a-ed3807134262',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.128573] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.128996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 856.129077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 856.129280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 856.129382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 856.129655] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d5e99a2-4df8-4714-aa2a-ed3807134262 already deleted. [ 856.129831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d5e99a2-4df8-4714-aa2a-ed3807134262" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 856.192873] env[61817]: INFO networking_nsxv3.common.synchronization [None req-06596b9e-8480-4f7b-a361-fd77b347e832 tempest-AttachInterfacesTestJSON-327680650 tempest-AttachInterfacesTestJSON-327680650-project-member] Enqueued Resource ID: 3d5e99a2-4df8-4714-aa2a-ed3807134262 with Priority: HIGHEST for action security_group_rules [ 856.193354] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d5e99a2-4df8-4714-aa2a-ed3807134262 with Priority: HIGHEST for action security_group_rules [ 856.193673] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.193801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 856.193865] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 856.194072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 856.194187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 856.194343] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d5e99a2-4df8-4714-aa2a-ed3807134262 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.194452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d5e99a2-4df8-4714-aa2a-ed3807134262" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 856.194520] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d5e99a2-4df8-4714-aa2a-ed3807134262" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 856.194676] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d5e99a2-4df8-4714-aa2a-ed3807134262" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 856.194768] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d5e99a2-4df8-4714-aa2a-ed3807134262',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.227575] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.227717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 856.227793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 856.228020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 856.228129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 856.228211] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d5e99a2-4df8-4714-aa2a-ed3807134262 already deleted. [ 856.228289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d5e99a2-4df8-4714-aa2a-ed3807134262" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 861.194826] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 861.194826] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 866.195612] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 866.195972] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 871.196415] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 871.196747] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 876.197418] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 876.197737] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 881.198065] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 881.198346] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 884.548911] env[61817]: INFO networking_nsxv3.common.synchronization [None req-f7905975-6eca-4d39-b0b8-3aa7112d55c2 tempest-TaggedBootDevicesTest-1269454556 tempest-TaggedBootDevicesTest-1269454556-project-member] Enqueued Resource ID: 63fbbdc0-9c08-446c-82d5-8742d9083ab6 with Priority: HIGHEST for action security_group_members [ 884.549432] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63fbbdc0-9c08-446c-82d5-8742d9083ab6 with Priority: HIGHEST for action security_group_members [ 884.549739] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.549871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 884.549947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 884.550136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 884.550238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 884.550397] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-63fbbdc0-9c08-446c-82d5-8742d9083ab6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.550489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 884.550553] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 884.550741] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 884.550886] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.550974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 884.551260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 884.551260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 884.551260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 884.551874] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63fbbdc0-9c08-446c-82d5-8742d9083ab6',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.568251] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.568461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 884.568461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 884.568687] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 884.568792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 884.568980] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.569078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 884.569140] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 884.569287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 884.569359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 884.569439] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63fbbdc0-9c08-446c-82d5-8742d9083ab6 already deleted. [ 884.569516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 884.774494] env[61817]: INFO networking_nsxv3.common.synchronization [None req-56c3243c-9019-4eb3-8bf7-9eafd68d4fa3 tempest-TaggedBootDevicesTest-1269454556 tempest-TaggedBootDevicesTest-1269454556-project-member] Enqueued Resource ID: 63fbbdc0-9c08-446c-82d5-8742d9083ab6 with Priority: HIGHEST for action security_group_members [ 884.775079] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63fbbdc0-9c08-446c-82d5-8742d9083ab6 with Priority: HIGHEST for action security_group_members [ 884.775384] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.775507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 884.775578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 884.775777] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 884.775863] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 884.776031] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-63fbbdc0-9c08-446c-82d5-8742d9083ab6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.776141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 884.776225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 884.776335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 884.776473] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.776577] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 884.776610] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 884.776744] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 884.776819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 884.776906] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63fbbdc0-9c08-446c-82d5-8742d9083ab6',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.799055] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.799211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 884.799284] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 884.799494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 884.799585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 884.799778] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.799897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 884.800123] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 884.800303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 884.800386] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 884.800475] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63fbbdc0-9c08-446c-82d5-8742d9083ab6 already deleted. [ 884.800553] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63fbbdc0-9c08-446c-82d5-8742d9083ab6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 889.775720] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 889.776127] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 894.776483] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 894.776812] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 899.778037] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 899.778293] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 904.779265] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 904.779603] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 909.780820] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 909.781135] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 914.781722] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 914.782057] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 919.783121] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 919.783473] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 924.784688] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 924.784930] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 927.707618] env[61817]: INFO networking_nsxv3.common.synchronization [req-4b0c7b35-b6ff-485d-bd95-eb24e2ad10cd req-4864739d-ab01-4e87-a141-7a1dc334d297 tempest-ServersTestJSON-63797321 tempest-ServersTestJSON-63797321-project-member] Enqueued Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGHEST for action security_group_members [ 927.707828] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGHEST for action security_group_members [ 927.708027] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.708156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 927.708220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 927.708426] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 927.708486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 927.708647] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.708758] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 927.708821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 927.708978] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 927.709115] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.709204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 927.709263] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 927.709400] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 927.709479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 927.709564] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.722187] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.722315] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 927.722385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 927.722578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 927.722683] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 927.722855] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.722964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 927.723019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 927.723147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 927.723220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 927.723300] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 is going to be updated. [ 927.777052] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.777243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 927.777243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 927.777470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 927.777589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 927.787555] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 in Status: IN_PROGRESS for 2s [ 928.873574] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f939953-a7cb-4e7b-b906-184203fbc784 req-611bd598-2380-46fd-a58c-3d600d0f599a tempest-ServersTestMultiNic-969860196 tempest-ServersTestMultiNic-969860196-project-member] Enqueued Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_members [ 928.874141] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_members [ 928.874461] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.874586] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 928.874653] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 928.874886] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 928.874969] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 928.875162] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.875272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 928.875310] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 928.875526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 928.875784] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.875885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 928.875947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 928.876258] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 928.876354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 928.876448] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.899718] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.899926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 928.900058] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 928.900313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 928.900443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 928.900724] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.900876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 928.900971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 928.901165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 928.901279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 928.901393] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 already deleted. [ 928.901505] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 929.373685] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f939953-a7cb-4e7b-b906-184203fbc784 req-27e929b3-45a0-434a-8019-cf051ff267e5 tempest-ServersTestMultiNic-969860196 tempest-ServersTestMultiNic-969860196-project-member] Enqueued Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_members [ 929.374182] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_members [ 929.374564] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.374716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 929.374843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 929.375109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 929.375236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 929.375408] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.375568] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 929.375679] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 929.375843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 929.375982] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.376088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 929.376149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 929.376294] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 929.376373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 929.376464] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.386617] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.386685] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 929.386723] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 929.386931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 929.387023] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 929.387204] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.387301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 929.387365] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 929.387513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 929.387592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 929.387675] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 already deleted. [ 929.387751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 929.799721] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 in Status: SUCCESS [ 929.799721] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 deletion is rescheduled due to dependency. [ 929.799721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.133223] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.134161] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.134161] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.134161] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.134161] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.134323] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-342 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.134323] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-342" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.134494] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-342" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.134695] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-342" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.134943] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.135096] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.135210] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.135418] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.135561] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.135877] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-342" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.135954] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.136462] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.136462] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.136462] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.136568] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.136753] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-d70380af-d6ed-4a3c-b595-0d9322f18ee4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.136916] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-d70380af-d6ed-4a3c-b595-0d9322f18ee4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.137089] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-d70380af-d6ed-4a3c-b595-0d9322f18ee4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.137467] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-d70380af-d6ed-4a3c-b595-0d9322f18ee4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.137686] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d70380af-d6ed-4a3c-b595-0d9322f18ee4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.153580] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.153764] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.153892] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.154164] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.154313] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.154466] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port d70380af-d6ed-4a3c-b595-0d9322f18ee4 not found, creating... [ 930.154872] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.154872] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.155280] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.155280] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.155441] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.155574] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.155728] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.155846] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.156071] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.156364] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.156364] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: d70380af-d6ed-4a3c-b595-0d9322f18ee4 is going to be created. [ 930.180926] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.181167] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.181271] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.181543] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.181847] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.182079] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-d70380af-d6ed-4a3c-b595-0d9322f18ee4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.661441] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f939953-a7cb-4e7b-b906-184203fbc784 req-00090301-c338-4fc1-82fc-f1f5a5d1266c service neutron] Enqueued Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_rules [ 930.661634] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f939953-a7cb-4e7b-b906-184203fbc784 req-00090301-c338-4fc1-82fc-f1f5a5d1266c service neutron] Enqueued Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_members [ 930.661785] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f939953-a7cb-4e7b-b906-184203fbc784 req-00090301-c338-4fc1-82fc-f1f5a5d1266c service neutron] Enqueued Resource ID: d70380af-d6ed-4a3c-b595-0d9322f18ee4 with Priority: HIGHEST for action port [ 930.662266] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_rules [ 930.662403] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_members [ 930.662502] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70380af-d6ed-4a3c-b595-0d9322f18ee4 with Priority: HIGHEST for action port [ 930.662784] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.662913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.662981] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.663173] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.663260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.663416] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.663514] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.663582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.663780] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.663857] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.664679] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.664791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.664856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.665003] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.665076] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.665216] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.665307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.665371] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.665500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.665630] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.665732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.665833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.665987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.665987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.666078] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.666752] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.666856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.666922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.667059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.667129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.667267] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-d70380af-d6ed-4a3c-b595-0d9322f18ee4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.667370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d70380af-d6ed-4a3c-b595-0d9322f18ee4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.667417] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d70380af-d6ed-4a3c-b595-0d9322f18ee4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.667532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d70380af-d6ed-4a3c-b595-0d9322f18ee4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.667599] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d70380af-d6ed-4a3c-b595-0d9322f18ee4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.685922] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.687046] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.687168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.687229] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.687411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.687484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.687629] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.687727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.696028] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d70380af-d6ed-4a3c-b595-0d9322f18ee4 with status ACTIVE [ 930.696028] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.696028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.696028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.696028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.696028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.696028] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.696028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.696443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.696443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.696443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.703588] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.710682] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.710839] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.710889] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.711078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.711158] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.711248] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 is going to be created. [ 930.746669] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.746913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 930.746913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 930.747009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 930.747166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 930.757176] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: UNINITIALIZED for 2s [ 931.011250] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.011471] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.011600] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.011918] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.012084] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.012350] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-271 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.012507] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-271" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.012624] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-271" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.012893] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-271" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.013131] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.013279] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.013390] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.013592] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.013727] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.013868] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-271" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.014107] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.014252] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.014361] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.014562] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.014689] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.014915] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-e6b341fc-a993-4108-ae2b-9eff9a9a426c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.015127] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-e6b341fc-a993-4108-ae2b-9eff9a9a426c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.015198] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-e6b341fc-a993-4108-ae2b-9eff9a9a426c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.015400] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-e6b341fc-a993-4108-ae2b-9eff9a9a426c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.015530] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6b341fc-a993-4108-ae2b-9eff9a9a426c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.017107] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.017217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.017276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.017426] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.017501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.017586] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d70380af-d6ed-4a3c-b595-0d9322f18ee4 is going to be updated. [ 931.037825] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.037963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.038042] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.038257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.038400] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.038556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d70380af-d6ed-4a3c-b595-0d9322f18ee4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.076306] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.076514] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.076634] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.077095] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.077095] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.077215] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port e6b341fc-a993-4108-ae2b-9eff9a9a426c not found, creating... [ 931.077455] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.077603] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.077811] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.077969] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.078103] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.078375] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.078607] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.078654] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.078840] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.078968] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.079100] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: e6b341fc-a993-4108-ae2b-9eff9a9a426c is going to be created. [ 931.098248] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.098459] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.098581] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.098859] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.099078] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.099304] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-e6b341fc-a993-4108-ae2b-9eff9a9a426c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.367213] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f939953-a7cb-4e7b-b906-184203fbc784 req-9eaa8d11-2a3e-4730-9d04-f9fd7bd61f6f service neutron] Enqueued Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_rules [ 931.367499] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f939953-a7cb-4e7b-b906-184203fbc784 req-9eaa8d11-2a3e-4730-9d04-f9fd7bd61f6f service neutron] Enqueued Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_members [ 931.367655] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f939953-a7cb-4e7b-b906-184203fbc784 req-9eaa8d11-2a3e-4730-9d04-f9fd7bd61f6f service neutron] Enqueued Resource ID: e6b341fc-a993-4108-ae2b-9eff9a9a426c with Priority: HIGHEST for action port [ 931.368265] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_rules [ 931.368420] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_members [ 931.368527] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6b341fc-a993-4108-ae2b-9eff9a9a426c with Priority: HIGHEST for action port [ 931.368858] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.369009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.369079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.369312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.369423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.369606] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.369710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.369932] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.370050] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.370115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.370300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.370380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.370600] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.370736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.370857] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.370981] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.371060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.371255] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.371344] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.371502] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6b341fc-a993-4108-ae2b-9eff9a9a426c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.371601] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6b341fc-a993-4108-ae2b-9eff9a9a426c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.371659] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6b341fc-a993-4108-ae2b-9eff9a9a426c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.371833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6b341fc-a993-4108-ae2b-9eff9a9a426c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.371922] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6b341fc-a993-4108-ae2b-9eff9a9a426c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.390534] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6b341fc-a993-4108-ae2b-9eff9a9a426c with status ACTIVE [ 931.390805] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.390942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.391011] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.391212] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.391300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.391464] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.391560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.391625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.391772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.391847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.701905] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.702213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.702213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.702349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.702421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.702532] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6b341fc-a993-4108-ae2b-9eff9a9a426c is going to be updated. [ 931.724500] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.724706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 931.724778] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 931.724938] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 931.725081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 931.725241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6b341fc-a993-4108-ae2b-9eff9a9a426c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 932.766925] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: SUCCESS [ 932.767230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 932.767306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 932.767520] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 932.767705] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.767835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 932.767892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 932.768028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 932.768145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 932.768204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 932.768286] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.769466] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 932.769583] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 932.769765] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.769905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 932.769966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 932.770147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 932.770211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 932.770292] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.784209] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.784394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 932.784441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 932.784609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 932.784805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 932.784874] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.784951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 932.785612] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.794631] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.804044] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.804234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 932.804297] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 932.804508] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 932.804594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 932.804690] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 is going to be updated. [ 932.836048] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.836218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 932.836266] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 932.836474] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 932.836623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 932.846527] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: IN_PROGRESS for 2s [ 934.858762] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: SUCCESS [ 934.858762] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 934.859245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 934.859245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 934.859382] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.859552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 934.859552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 934.859683] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 934.859760] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 934.859849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 934.860017] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.860125] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 934.860201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 934.860326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 934.860433] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 934.860598] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.860775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 934.860842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 934.860983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 934.861122] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.861220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 934.861291] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 934.861608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 934.861791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 934.861791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 934.861926] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.868531] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd22888a-f333-48c2-a433-ab2abba8ae54: rpc.has_security_group_logging(os_id): False [ 934.886615] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.886790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 934.886880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 934.887038] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 934.887120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 934.887334] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.887445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 934.887518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 934.887628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 934.887702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 934.887866] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.887971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 934.888048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 934.888166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 934.888241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 934.888430] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.888524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 934.888609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 934.888787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 934.888866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 934.888956] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 is going to be created. [ 934.951910] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.952301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 934.952473] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 934.952773] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 934.953080] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 934.967672] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: IN_PROGRESS for 2s [ 935.038133] env[61817]: INFO networking_nsxv3.common.synchronization [None req-21ba5f32-109a-4a82-9445-2d99ea7f2f1e None None] Enqueued Resource ID: 78f8e684-9b92-4fee-a382-aa73e4624f91 with Priority: HIGHEST for action port [ 935.038133] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f8e684-9b92-4fee-a382-aa73e4624f91 with Priority: HIGHEST for action port [ 935.038133] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.038133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 935.038133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 935.038669] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 935.038983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 935.039323] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-78f8e684-9b92-4fee-a382-aa73e4624f91 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.039556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78f8e684-9b92-4fee-a382-aa73e4624f91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 935.039720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78f8e684-9b92-4fee-a382-aa73e4624f91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 935.040048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78f8e684-9b92-4fee-a382-aa73e4624f91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 935.040249] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78f8e684-9b92-4fee-a382-aa73e4624f91',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.060133] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78f8e684-9b92-4fee-a382-aa73e4624f91 [ 935.060353] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.060490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 935.060558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 935.060849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 935.060941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 935.061142] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78f8e684-9b92-4fee-a382-aa73e4624f91 already deleted. [ 935.061142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78f8e684-9b92-4fee-a382-aa73e4624f91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 936.783117] env[61817]: INFO networking_nsxv3.common.synchronization [None req-42c0d474-3599-4b4b-84c8-86d6e844bd5b tempest-ServerActionsTestOtherB-280984654 tempest-ServerActionsTestOtherB-280984654-project-member] Enqueued Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGHEST for action security_group_rules [ 936.783483] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGHEST for action security_group_rules [ 936.783483] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.783689] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 936.783689] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 936.783689] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 936.783689] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 936.783689] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.783689] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 936.783689] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 936.784727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 936.784727] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.826805] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.826805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 936.826805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 936.826805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 936.826805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 936.826805] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a already deleted. [ 936.827803] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 936.884199] env[61817]: INFO networking_nsxv3.common.synchronization [None req-30532b82-12e6-4dd0-b6e0-a54498ecf006 None None] Enqueued Resource ID: 78f68579-3403-4c6b-afa6-688251f012db with Priority: HIGHEST for action port [ 936.884418] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f68579-3403-4c6b-afa6-688251f012db with Priority: HIGHEST for action port [ 936.884988] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.885110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 936.885166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 936.885368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 936.885452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 936.885606] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-78f68579-3403-4c6b-afa6-688251f012db taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.885700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78f68579-3403-4c6b-afa6-688251f012db" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 936.885763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78f68579-3403-4c6b-afa6-688251f012db" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 936.886092] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78f68579-3403-4c6b-afa6-688251f012db" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 936.886187] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78f68579-3403-4c6b-afa6-688251f012db',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.905250] env[61817]: INFO networking_nsxv3.common.synchronization [None req-c44acfe6-84df-44e7-8b0e-43f0d3909f7a tempest-ServerActionsTestOtherB-280984654 tempest-ServerActionsTestOtherB-280984654-project-member] Enqueued Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGHEST for action security_group_rules [ 936.905732] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGHEST for action security_group_rules [ 936.906083] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.906254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 936.906303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 936.906468] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 936.906554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 936.906781] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.906846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 936.906846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 936.907085] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 936.907133] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.935073] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78f68579-3403-4c6b-afa6-688251f012db [ 936.935286] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.935415] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 936.935482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 936.935682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 936.935771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 936.935863] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78f68579-3403-4c6b-afa6-688251f012db already deleted. [ 936.935944] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78f68579-3403-4c6b-afa6-688251f012db" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 936.979658] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: SUCCESS [ 936.979869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 936.980053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 936.980269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 936.980349] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.982416] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.982555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 936.982613] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 936.982768] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 936.982850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 936.982935] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a already deleted. [ 936.983012] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.003650] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.003812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.003851] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.004064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.004150] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.004306] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.004403] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.004460] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.004609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.004743] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.004843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.004885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.005020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.005093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.005169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.005252] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.028420] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.028420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.028420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.028420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.028420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.028420] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.028736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.028736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.028736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.028883] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.028950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.029000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.029133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.029206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.029281] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.029424] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.029516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.029562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.029697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.029764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.029897] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.030198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.030198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.030198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.030311] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.030389] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.030427] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.030551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.030623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.030762] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.030848] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.047918] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd22888a-f333-48c2-a433-ab2abba8ae54: rpc.has_security_group_logging(os_id): False [ 937.069691] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.069837] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.069905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.070110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.070199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.070405] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.070500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.070560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.070785] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.070857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.071039] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.071130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.071189] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.071327] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.071396] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.071584] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.071695] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.071761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.071905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.071981] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.072091] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 is going to be updated. [ 937.138574] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.138755] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 937.138755] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 937.138967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 937.139112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 937.151793] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: IN_PROGRESS for 2s [ 939.166397] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: SUCCESS [ 939.166742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 941.906530] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 941.906861] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 946.908058] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 946.908416] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 951.909795] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 951.910080] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 956.911127] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 956.911410] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 961.912190] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 961.912476] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 966.913692] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 966.913994] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 971.915457] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 971.915749] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 976.916690] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 976.917041] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 979.132863] env[61817]: INFO networking_nsxv3.common.synchronization [req-5baa18af-c69b-41ca-8a11-082d298d37de req-1ed0ba84-25a7-4d2a-bd0f-b1b7d7da8e93 tempest-ImagesTestJSON-1042540315 tempest-ImagesTestJSON-1042540315-project-member] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 979.133366] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 979.133678] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.133832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.133869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.134052] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.134130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.134278] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.134373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.134436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.134598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.134731] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.134829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.134883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.135005] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.135080] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.135164] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.146029] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.146609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.146703] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.147055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.147208] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.147415] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.147525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.147578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.147735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.147818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.147896] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b already deleted. [ 979.147972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.507062] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.507257] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.507378] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.507646] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.507793] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.508057] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-16 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.508215] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.508330] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.508589] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.508833] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.509004] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.509123] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.509336] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.509479] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.509642] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.509888] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.510039] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.510518] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.510818] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.510964] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.511208] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-9f030bea-e7a1-48fe-901d-cac6c72e7e40 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.511364] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-9f030bea-e7a1-48fe-901d-cac6c72e7e40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.511481] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-9f030bea-e7a1-48fe-901d-cac6c72e7e40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.511764] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-9f030bea-e7a1-48fe-901d-cac6c72e7e40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.511904] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f030bea-e7a1-48fe-901d-cac6c72e7e40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.526628] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.526826] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.526951] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.527194] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.527343] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.527492] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 9f030bea-e7a1-48fe-901d-cac6c72e7e40 not found, creating... [ 979.527735] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.527891] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.528014] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.528254] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.528393] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.528776] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.528938] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.529055] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.529262] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.529393] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.529531] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 9f030bea-e7a1-48fe-901d-cac6c72e7e40 is going to be created. [ 979.552782] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.552782] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.552782] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.552782] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.552782] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.552782] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-9f030bea-e7a1-48fe-901d-cac6c72e7e40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.779940] env[61817]: INFO networking_nsxv3.common.synchronization [req-5baa18af-c69b-41ca-8a11-082d298d37de req-435e9581-b9f1-4a6c-bf9c-a173e795eb9d service neutron] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_rules [ 979.780135] env[61817]: INFO networking_nsxv3.common.synchronization [req-5baa18af-c69b-41ca-8a11-082d298d37de req-435e9581-b9f1-4a6c-bf9c-a173e795eb9d service neutron] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 979.780272] env[61817]: INFO networking_nsxv3.common.synchronization [req-5baa18af-c69b-41ca-8a11-082d298d37de req-435e9581-b9f1-4a6c-bf9c-a173e795eb9d service neutron] Enqueued Resource ID: 9f030bea-e7a1-48fe-901d-cac6c72e7e40 with Priority: HIGHEST for action port [ 979.780500] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_rules [ 979.780621] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 979.780841] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f030bea-e7a1-48fe-901d-cac6c72e7e40 with Priority: HIGHEST for action port [ 979.781426] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.781551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.781626] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.781902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.781992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.782156] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.782252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.782311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.782521] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.782595] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.783562] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.783562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.783687] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.783821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.783915] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.785045] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.785186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.785278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.785480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.785661] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.785789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.785876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.786046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.786155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.786269] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.788962] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.789128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.789211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.789395] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.789500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.789671] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f030bea-e7a1-48fe-901d-cac6c72e7e40 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.789931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f030bea-e7a1-48fe-901d-cac6c72e7e40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.790033] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f030bea-e7a1-48fe-901d-cac6c72e7e40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.790204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f030bea-e7a1-48fe-901d-cac6c72e7e40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.790307] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f030bea-e7a1-48fe-901d-cac6c72e7e40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.798428] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.826624] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.829440] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.829615] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.829714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.830077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.830204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.830392] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.830508] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.850013] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.850750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.852103] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.852387] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.852529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.852667] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be created. [ 979.854016] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f030bea-e7a1-48fe-901d-cac6c72e7e40 with status ACTIVE [ 979.857098] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.857300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.857448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.857654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.857831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.858088] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.858234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.858949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.859163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.859315] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.905335] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.905504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 979.905576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 979.905783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 979.905940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 979.915447] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: UNINITIALIZED for 2s [ 980.295415] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.295740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 980.295740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 980.295849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 980.295939] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 980.296060] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f030bea-e7a1-48fe-901d-cac6c72e7e40 is going to be updated. [ 980.318795] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.318962] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 980.319034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 980.319250] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 980.319395] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 980.319567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f030bea-e7a1-48fe-901d-cac6c72e7e40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.926960] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 981.927274] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.927320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 981.927524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 981.927711] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.927822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 981.927882] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 981.928065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 981.928148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.928287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.928344] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.937592] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.937730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 981.937792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 981.937981] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 981.938064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.938225] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.938319] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 981.938382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 981.938526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 981.938715] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.938814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 981.938876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 981.939020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 981.939100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.939195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.939346] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.939437] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 981.939497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 981.939636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 981.939710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.939849] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.939937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 981.939994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 981.940153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 981.940285] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.940373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 981.940432] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 981.940565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 981.940644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.940778] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.940870] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.948834] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a2644aa-f99a-4b14-9145-702ba5c8452b: rpc.has_security_group_logging(os_id): False [ 981.969169] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.969309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 981.969455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 981.969580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 981.969666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.969873] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.969965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 981.970023] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 981.970169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 981.970486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.970486] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.970599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 981.970599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 981.970744] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 981.970929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.971019] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.971085] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 981.971142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 981.971278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 981.971348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 981.971428] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be created. [ 982.031141] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.031719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 982.031807] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 982.032040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 982.032231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 982.046194] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 982.869423] env[61817]: INFO networking_nsxv3.common.synchronization [None req-53a851fc-03c7-4475-9a29-728a2f7a2aa1 None None] Enqueued Resource ID: 38f76b6e-4eb7-48aa-8da8-b2c5a579c739 with Priority: HIGHEST for action port [ 982.869791] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38f76b6e-4eb7-48aa-8da8-b2c5a579c739 with Priority: HIGHEST for action port [ 982.870585] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.870831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 982.870831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 982.871209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 982.871209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 982.871343] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-38f76b6e-4eb7-48aa-8da8-b2c5a579c739 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.871438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38f76b6e-4eb7-48aa-8da8-b2c5a579c739" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 982.871497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38f76b6e-4eb7-48aa-8da8-b2c5a579c739" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 982.871763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38f76b6e-4eb7-48aa-8da8-b2c5a579c739" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 982.871906] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38f76b6e-4eb7-48aa-8da8-b2c5a579c739',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.881477] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38f76b6e-4eb7-48aa-8da8-b2c5a579c739 [ 982.881849] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.882057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 982.882161] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 982.882388] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 982.882525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 982.882653] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38f76b6e-4eb7-48aa-8da8-b2c5a579c739 already deleted. [ 982.882770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38f76b6e-4eb7-48aa-8da8-b2c5a579c739" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 984.060201] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 984.060589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 984.924274] env[61817]: INFO networking_nsxv3.common.synchronization [None req-5802fea8-7cd0-4fd3-a9fb-c175673f20c2 None None] Enqueued Resource ID: df2e19f9-a022-4257-8a4b-1f2cf16b583c with Priority: HIGHEST for action port [ 984.924529] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2e19f9-a022-4257-8a4b-1f2cf16b583c with Priority: HIGHEST for action port [ 984.925111] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.925242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 984.925311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 984.925510] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 984.925596] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 984.925750] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-df2e19f9-a022-4257-8a4b-1f2cf16b583c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.925845] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df2e19f9-a022-4257-8a4b-1f2cf16b583c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 984.925908] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df2e19f9-a022-4257-8a4b-1f2cf16b583c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 984.926123] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df2e19f9-a022-4257-8a4b-1f2cf16b583c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 984.926203] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df2e19f9-a022-4257-8a4b-1f2cf16b583c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.953029] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df2e19f9-a022-4257-8a4b-1f2cf16b583c [ 984.953161] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.953282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 984.953346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 984.953536] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 984.953627] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 984.953718] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df2e19f9-a022-4257-8a4b-1f2cf16b583c already deleted. [ 984.953822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df2e19f9-a022-4257-8a4b-1f2cf16b583c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 989.925665] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 989.926017] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 994.926356] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 994.926616] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 997.000090] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 997.000406] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:2 started [ 998.227812] env[61817]: INFO networking_nsxv3.common.synchronization [None req-3746a0aa-120f-4905-81d5-480251ce145d None None] Enqueued Resource ID: 681087a4-4133-4976-8e7d-878d0922437e with Priority: HIGHEST for action port [ 998.228358] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 681087a4-4133-4976-8e7d-878d0922437e with Priority: HIGHEST for action port [ 998.228705] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.228838] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 998.228907] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 998.229111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 998.229196] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 998.229366] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-681087a4-4133-4976-8e7d-878d0922437e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.229462] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-681087a4-4133-4976-8e7d-878d0922437e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 998.229525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-681087a4-4133-4976-8e7d-878d0922437e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 998.229726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-681087a4-4133-4976-8e7d-878d0922437e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 998.229809] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('681087a4-4133-4976-8e7d-878d0922437e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.284277] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 681087a4-4133-4976-8e7d-878d0922437e [ 998.284526] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.284656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 998.284719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 998.284963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 998.285056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 998.285155] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:681087a4-4133-4976-8e7d-878d0922437e already deleted. [ 998.285247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-681087a4-4133-4976-8e7d-878d0922437e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1000.296669] env[61817]: INFO networking_nsxv3.common.synchronization [None req-bbbe8d23-473c-41f0-beb0-265319512c72 None None] Enqueued Resource ID: 3c24b48f-2734-4007-b9d9-bac6eca49524 with Priority: HIGHEST for action port [ 1000.296965] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c24b48f-2734-4007-b9d9-bac6eca49524 with Priority: HIGHEST for action port [ 1000.297483] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.297912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1000.297987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1000.298186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1000.298269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1000.299049] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c24b48f-2734-4007-b9d9-bac6eca49524 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.299049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c24b48f-2734-4007-b9d9-bac6eca49524" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1000.299049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c24b48f-2734-4007-b9d9-bac6eca49524" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1000.299049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c24b48f-2734-4007-b9d9-bac6eca49524" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1000.299049] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c24b48f-2734-4007-b9d9-bac6eca49524',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.313582] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c24b48f-2734-4007-b9d9-bac6eca49524 [ 1000.313793] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.313956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1000.313995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1000.314261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1000.314261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1000.314359] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c24b48f-2734-4007-b9d9-bac6eca49524 already deleted. [ 1000.314440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c24b48f-2734-4007-b9d9-bac6eca49524" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1001.831520] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.831867] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1001.831867] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1001.832012] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1001.832110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1001.832300] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.832400] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1001.832463] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1001.832616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1001.832723] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.841830] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.849233] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.856840] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1001.857275] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1002.525309] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.525511] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.525511] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.525679] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.539393] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1002.539996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.541815] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1002.575574] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.575708] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.575785] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.576160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.581473] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.581973] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1002.582056] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1002.582137] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1002.609475] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.609617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.609673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.609880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.610383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.610511] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1002.649067] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.649256] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.649304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.649498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.649700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.649851] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1002.694933] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.695094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.695169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.695380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.695529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.695698] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:10. [ 1002.695782] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'916dc4e3-1bc8-4ba5-b319-d9d0dee54564', '9efe5fcd-faf9-44dd-ac10-abd106d2dc72', 'bd22888a-f333-48c2-a433-ab2abba8ae54', '1266a9f5-7050-4473-ad65-329e9724ea7d', '6d193cbd-452d-400d-b88e-58fc27978848', '62ddbcee-1db4-4515-8d5b-c25d44008cc0', '5a2644aa-f99a-4b14-9145-702ba5c8452b', '5233168b-5f93-4bb0-bac2-dd279d965d46', '905dd5f8-1bc0-4560-8294-1733c7eaf6f4', 'c5573ccf-d866-40ac-9bb4-1fa04e91ef9c'} {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1002.695857] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1002.715368] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.715537] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.715584] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.715779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.715860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.715968] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1002.716077] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1002.716148] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1002.756044] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.756044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.756044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.756044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.756312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.756372] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1002.756432] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1002.756502] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1002.756571] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1002.756647] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 10/10 resources of Type:Security Group Rules [ 1002.756721] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGH for action security_group_rules [ 1002.756802] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGH for action security_group_rules [ 1002.756870] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGH for action security_group_rules [ 1002.756934] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGH for action security_group_rules [ 1002.756997] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGH for action security_group_rules [ 1002.757060] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGH for action security_group_rules [ 1002.757192] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 1002.757230] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 1002.757270] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGH for action security_group_rules [ 1002.757332] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGH for action security_group_rules [ 1002.757401] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1002.757465] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1002.757645] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.757751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.757814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.757980] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.758058] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.758229] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.758320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.758380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.758519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.758592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.758763] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.758846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.758905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.759042] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.759115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.759276] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.759364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.759422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.759559] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.759631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.759803] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.759895] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.759953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.760164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.760238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.760402] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.760490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.760549] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.760705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.760814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.760982] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.761073] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.761132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.761272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.761345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.761506] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.761596] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.761666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.761816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.761891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.762054] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.762148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.762196] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.762330] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.762402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.762562] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.762652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.762833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.762992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.763077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.763250] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.763346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.763401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.763536] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.763609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.763771] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.763862] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.763920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.764077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.764147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.764301] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.764385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.764439] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.764569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.764637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.764798] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.764885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.764943] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.765100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.765181] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.765346] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.765524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.765524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.765621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.765702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.765847] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.765935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.765993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.766127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.766199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.766420] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.766526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.766585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.766725] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.766856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.767027] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.767116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.767224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.767306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.767405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.767549] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.767612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.767672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.767806] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.767877] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.768062] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.768137] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1002.768220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1002.768394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1002.768469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1002.768573] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:10 [ 1002.768685] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 10 of least updated resources [ 1002.768742] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGH for action security_group_members [ 1002.768829] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 with Priority: HIGH for action port [ 1002.768903] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62fdd978-7275-4c69-bc24-dd1fda84275a with Priority: HIGH for action port [ 1002.768971] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGH for action security_group_members [ 1002.769038] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 962e2556-54e1-4677-bf83-97889db7f5cc with Priority: HIGH for action port [ 1002.769104] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGH for action security_group_members [ 1002.769170] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_members [ 1002.769238] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGH for action security_group_members [ 1002.769304] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ef38466-6323-45ab-a015-6bf146d59bbd with Priority: HIGH for action port [ 1002.769370] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d78e0d1d-229a-4a36-86a2-a2326aa34843 with Priority: HIGH for action port [ 1002.769465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.665480] env[61817]: INFO networking_nsxv3.common.synchronization [None req-da8637c1-4894-42b3-b3a5-c0e24bc0e5a2 None None] Enqueued Resource ID: 25aaa8d9-04b8-472c-8e01-ff69b5b49827 with Priority: HIGHEST for action port [ 1003.665780] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25aaa8d9-04b8-472c-8e01-ff69b5b49827 with Priority: HIGHEST for action port [ 1003.666010] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGH for action security_group_rules [ 1003.666189] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGH for action security_group_rules [ 1003.666381] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 1003.666579] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 962e2556-54e1-4677-bf83-97889db7f5cc with Priority: HIGH for action port [ 1003.666782] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d78e0d1d-229a-4a36-86a2-a2326aa34843 with Priority: HIGH for action port [ 1003.666980] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef38466-6323-45ab-a015-6bf146d59bbd with Priority: HIGH for action port [ 1003.667191] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGH for action security_group_members [ 1003.667385] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_members [ 1003.667583] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGH for action security_group_members [ 1003.667777] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGH for action security_group_members [ 1003.667958] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62fdd978-7275-4c69-bc24-dd1fda84275a with Priority: HIGH for action port [ 1003.668298] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 with Priority: HIGH for action port [ 1003.668503] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGH for action security_group_members [ 1003.668784] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGH for action security_group_rules [ 1003.668966] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGH for action security_group_rules [ 1003.669081] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGH for action security_group_rules [ 1003.669186] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 1003.669282] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGH for action security_group_rules [ 1003.669377] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGH for action security_group_rules [ 1003.669472] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGH for action security_group_rules [ 1003.670401] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.670599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.670789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.671062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.671202] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.671423] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-25aaa8d9-04b8-472c-8e01-ff69b5b49827 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.671573] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25aaa8d9-04b8-472c-8e01-ff69b5b49827" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.671710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25aaa8d9-04b8-472c-8e01-ff69b5b49827" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.671971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25aaa8d9-04b8-472c-8e01-ff69b5b49827" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.672117] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25aaa8d9-04b8-472c-8e01-ff69b5b49827',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.673461] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.673653] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.673765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.673976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.674106] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.674309] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.674451] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.674551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.674746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.674989] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.675958] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.676216] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.676324] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.676521] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.676644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.676825] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.676959] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.677053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.677311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.677311] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.678307] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.678518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.678692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.678900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.679027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.679322] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.679425] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.679425] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.679751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.680039] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.681247] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.681247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.681247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.681493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.681608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.681811] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-962e2556-54e1-4677-bf83-97889db7f5cc taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.681964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-962e2556-54e1-4677-bf83-97889db7f5cc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.682062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-962e2556-54e1-4677-bf83-97889db7f5cc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.682370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-962e2556-54e1-4677-bf83-97889db7f5cc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.682494] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('962e2556-54e1-4677-bf83-97889db7f5cc',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.685514] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.685677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.685812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.686078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.686239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.686432] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-d78e0d1d-229a-4a36-86a2-a2326aa34843 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.686573] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d78e0d1d-229a-4a36-86a2-a2326aa34843" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.686682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d78e0d1d-229a-4a36-86a2-a2326aa34843" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.686874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d78e0d1d-229a-4a36-86a2-a2326aa34843" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.687042] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d78e0d1d-229a-4a36-86a2-a2326aa34843',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.692872] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.692872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.692872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.692872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.692872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.692872] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ef38466-6323-45ab-a015-6bf146d59bbd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.692872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ef38466-6323-45ab-a015-6bf146d59bbd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.692872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ef38466-6323-45ab-a015-6bf146d59bbd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.692872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ef38466-6323-45ab-a015-6bf146d59bbd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.692872] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ef38466-6323-45ab-a015-6bf146d59bbd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.692872] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.692872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.692872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.692872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.692872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.692872] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.692872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.693528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.693528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.693528] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.693528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.693528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.693528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.693528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.693528] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.693528] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.693528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.693528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.693969] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.694074] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.694273] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.694415] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.694510] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.694694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.694907] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.695388] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.695498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.695702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.695826] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.695945] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.696990] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.697157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.697278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.697478] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.697620] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.697805] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.697977] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.698076] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.698373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.698564] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.698788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.698788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.698992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.699115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.699238] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.700235] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.700529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.700677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.700880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.701018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.701207] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.701392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.701491] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.701731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.701916] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.702056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.702154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.702365] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.702490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.702612] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.702937] env[61817]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 1003.703776] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.703946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.704086] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.704271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.704395] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.704579] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-62fdd978-7275-4c69-bc24-dd1fda84275a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.704729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62fdd978-7275-4c69-bc24-dd1fda84275a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.704830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62fdd978-7275-4c69-bc24-dd1fda84275a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.705017] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62fdd978-7275-4c69-bc24-dd1fda84275a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.705230] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62fdd978-7275-4c69-bc24-dd1fda84275a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.706290] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.706456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.706564] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.706765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.706893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.707079] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.707235] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.707335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.707519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.707637] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.708550] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.708788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.708894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.709114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.709240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.709441] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.709697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.709697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.709914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.710181] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.710340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.710424] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.710759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.710893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.714858] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.714858] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.714858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.714858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.714858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.714858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.714858] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.714858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.714858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.714858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.714858] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.715285] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.715433] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.715542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.715735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.715985] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.716285] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.716434] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.716531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.716715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.716825] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.717935] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.718213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.718213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.718397] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.718994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.719191] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.719333] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.719428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.719615] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.719726] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.720589] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.720909] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.721045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.721234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.721494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.721692] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.721854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.721958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.722566] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.722694] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.723902] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.724098] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.724210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.724407] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.724533] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.724720] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.724863] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.724970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.725158] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.725276] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.726103] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.726270] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.726379] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.726602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.726728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.726926] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.727068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.727167] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.727351] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.727465] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.728304] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.728472] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.728594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.728798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.728924] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.729116] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.729258] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.729356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.729539] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.729658] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.729953] env[61817]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1003.733643] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 962e2556-54e1-4677-bf83-97889db7f5cc with status ACTIVE [ 1003.733780] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.733937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.734088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.734295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.734429] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.734641] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.734787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.734912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.735098] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.735243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.738378] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25aaa8d9-04b8-472c-8e01-ff69b5b49827 [ 1003.738378] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.738580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.739276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.739276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.739276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.739276] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25aaa8d9-04b8-472c-8e01-ff69b5b49827 already deleted. [ 1003.739276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25aaa8d9-04b8-472c-8e01-ff69b5b49827" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.739500] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.739654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.739754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.739948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.740114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.740307] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.740449] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.740551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.740759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.740955] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.741241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.741371] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.741591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.741710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.741862] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.741991] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.749499] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.749709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.749818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.750049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.750312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.750525] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.750677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.750793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.751378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.751606] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.751796] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.751903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.752112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.752368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.752368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.752549] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.760569] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.760569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.760569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.760569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.760569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.760569] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.760569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.760840] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.761005] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.761092] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.761378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.761533] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.761825] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.762021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.762111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.762303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.762491] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.762628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.762722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.763003] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.763147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.763272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.763474] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.763879] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.764021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.764248] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.764368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.764552] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.764690] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.764784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.764964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.765234] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.765453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.765564] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.765754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.765882] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.766007] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.766158] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.770811] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.771157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.771157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.771361] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.771487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.771719] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.771881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.771986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.772247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.772449] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.772612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.772714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.773151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.773151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.773151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.773287] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.773421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.773518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.773705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.773829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.774015] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.774168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.774300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.774489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.774675] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.774818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.774967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.775105] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.775222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.775343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.775482] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.781272] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d78e0d1d-229a-4a36-86a2-a2326aa34843 with status ACTIVE [ 1003.781678] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.781678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.781853] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.782128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.782262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.782522] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.782668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.782772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.782974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.783222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.785100] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd22888a-f333-48c2-a433-ab2abba8ae54: rpc.has_security_group_logging(os_id): False [ 1003.791685] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a2644aa-f99a-4b14-9145-702ba5c8452b: rpc.has_security_group_logging(os_id): False [ 1003.827389] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.827539] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.827613] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.827828] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.829627] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.829738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.866092] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.867068] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.870425] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.870557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.871857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.872081] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.872201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.872267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.872598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.872689] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.872892] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.872993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.873051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.873204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.873270] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.873452] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.873524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.873582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.873719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.873792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.873875] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 is going to be updated. [ 1003.875181] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.875336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.878356] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.878356] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.894414] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.895325] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.895456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.895525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.895729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.895815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.895968] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.896089] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.906745] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.906905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.906977] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.907188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.907264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.907430] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.907502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.911621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.911895] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.912021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.912099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.912291] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.912377] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.912576] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.912677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.912741] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.912920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.913370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.913582] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.913671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.913739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.913970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.913970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.914029] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1003.915445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.915603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.933347] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.933502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.933541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.933755] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.933874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.933956] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.934041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.934256] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.934349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.934408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.934556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.934629] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.934813] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.934909] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.935159] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62fdd978-7275-4c69-bc24-dd1fda84275a with status ACTIVE [ 1003.935159] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.935275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.935275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.935419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.935666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.935847] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.935960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.936001] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.936447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.936447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.939392] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.940177] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ef38466-6323-45ab-a015-6bf146d59bbd with status ACTIVE [ 1003.940369] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.940513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.940576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.940772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.940891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.941065] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.941162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.941299] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.941374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.941442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.943224] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.943336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.943403] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.943657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.943657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.943790] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.943919] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.943965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.944315] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.944315] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.944489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.944489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.944812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.944812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.944812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.944812] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.949265] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.949390] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.949449] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.949667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.949722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.949845] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.949996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.949996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.950132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.950274] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.950656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.950656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.950656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.950656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.950813] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.950813] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.951580] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.952483] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.953054] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.953621] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.956267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.956373] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 is going to be deleted. [ 1003.958397] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 with status ACTIVE [ 1003.958586] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.958718] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.958786] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.958978] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.959133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.959326] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.959422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.959614] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.959652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.959714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.974273] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.974431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.974547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.974825] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.974941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.975197] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.975313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.975313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.975509] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.975804] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.975804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.975901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.976089] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.976428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.976428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.976621] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.976686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.976715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.976897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.977135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.977135] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.977211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.977241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.977430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.977641] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.977709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.977739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.977989] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.978114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.978205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.978317] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.980432] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.980432] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.980525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.980779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.980896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.981044] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1266a9f5-7050-4473-ad65-329e9724ea7d is going to be updated. [ 1003.982988] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.986456] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.986557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.986557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.986773] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.992552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.992552] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 is going to be updated. [ 1003.992552] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.992552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.992552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.992552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.992552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.992552] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 is going to be updated. [ 1003.994547] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d193cbd-452d-400d-b88e-58fc27978848: rpc.has_security_group_logging(os_id): False [ 1003.996409] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.996409] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1003.996544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1003.996754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1003.996848] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1003.997002] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c is going to be updated. [ 1004.003979] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62ddbcee-1db4-4515-8d5b-c25d44008cc0: rpc.has_security_group_logging(os_id): False [ 1004.009489] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.009631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.009674] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.009871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.009959] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.010049] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1004.020204] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.020613] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.020714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.020952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.021126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.035081] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.035241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.035319] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.035494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.035643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.081951] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.082209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.082209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.082430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.091550] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1004.100387] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.100582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.102919] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: IN_PROGRESS for 2s [ 1004.134795] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.134938] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.135009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.135504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.135504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.136920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.137212] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.137309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.137378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.137560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.137642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.137728] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d193cbd-452d-400d-b88e-58fc27978848 is going to be updated. [ 1004.139101] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.139278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.149227] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.149398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.149442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.149633] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.149870] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.160077] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1266a9f5-7050-4473-ad65-329e9724ea7d in Status: IN_PROGRESS for 2s [ 1004.167227] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.167398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.167398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.167561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.167697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.169659] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 in Status: IN_PROGRESS for 2s [ 1004.201827] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 in Status: IN_PROGRESS for 2s [ 1004.213699] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.213886] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.214015] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.214192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.214345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.216346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.216597] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.216721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.216794] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.216976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.217056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.217264] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.217375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.217435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.217563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.217635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.217818] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.217907] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.217993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.218107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.218181] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.218265] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 is going to be updated. [ 1004.232738] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c in Status: IN_PROGRESS for 2s [ 1004.233955] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.234080] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.234080] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.234260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.235684] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.241487] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.241899] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.242075] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.242365] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.242541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.242743] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.261156] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1004.394205] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.394484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.394484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.394634] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.394788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.409152] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.409304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1004.409361] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1004.409569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1004.409718] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1004.434931] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 in Status: IN_PROGRESS for 2s [ 1004.435619] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d193cbd-452d-400d-b88e-58fc27978848 in Status: IN_PROGRESS for 2s [ 1005.553062] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1005.553699] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.553889] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.553969] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.554202] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.554300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.554396] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d78e0d1d-229a-4a36-86a2-a2326aa34843 is going to be updated. [ 1005.570110] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.570284] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.570326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.570530] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.570622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.570787] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 962e2556-54e1-4677-bf83-97889db7f5cc is going to be updated. [ 1005.579854] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.579983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.580073] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.580280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.580422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.580584] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d78e0d1d-229a-4a36-86a2-a2326aa34843" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.582535] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1005.583049] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.583278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.583375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.583594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.583721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.583829] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ef38466-6323-45ab-a015-6bf146d59bbd is going to be updated. [ 1005.585603] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.585731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.585803] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.586002] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.586091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.586201] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0 is going to be updated. [ 1005.588318] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.588434] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.588503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.588728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.588823] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.588911] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62fdd978-7275-4c69-bc24-dd1fda84275a is going to be updated. [ 1005.603796] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.603976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.604071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.604241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.604387] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.604530] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-962e2556-54e1-4677-bf83-97889db7f5cc" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.613073] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1005.613645] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.613829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.613925] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.614136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.614278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.614443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9d6cf52-bbd4-4cbd-9f2f-39a4dadf3fe0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.615168] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1005.615556] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.615678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.615748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.615945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.616095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.616244] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ef38466-6323-45ab-a015-6bf146d59bbd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.616838] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1005.617345] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.617457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1005.617547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1005.617709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1005.617823] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1005.617960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62fdd978-7275-4c69-bc24-dd1fda84275a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.106102] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1006.106375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.117047] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: SUCCESS [ 1006.117284] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.169540] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1266a9f5-7050-4473-ad65-329e9724ea7d in Status: SUCCESS [ 1006.169765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.170883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.171106] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.171298] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.171420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.171487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.171640] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.171747] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.171839] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.171931] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.180306] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 in Status: SUCCESS [ 1006.180306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.180438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.180749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.180951] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.181072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.181138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.181302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.181386] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.181473] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.183003] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.184620] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.195099] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.196317] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1266a9f5-7050-4473-ad65-329e9724ea7d: rpc.has_security_group_logging(os_id): False [ 1006.201107] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 905dd5f8-1bc0-4560-8294-1733c7eaf6f4: rpc.has_security_group_logging(os_id): False [ 1006.212862] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 in Status: SUCCESS [ 1006.213096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.213556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.213784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.213982] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.214100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.214165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.214319] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.214406] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.214492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.214582] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.216286] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.216393] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.216464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.216625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.221150] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.221266] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.224620] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.224747] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.224821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.225558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.225646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.225815] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.225921] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.225986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.226154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.226725] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.226833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.226914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.227507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.227630] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.227724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.227889] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.227986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.228068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.228214] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.228285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.228425] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.229956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.229956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.230122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.231856] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.231965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.232051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.232209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.232500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.232500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.232500] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.238816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.239134] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.239254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.239391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.239602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.239696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.239788] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1266a9f5-7050-4473-ad65-329e9724ea7d is going to be updated. [ 1006.245282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.245567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.248877] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c in Status: SUCCESS [ 1006.249075] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.249298] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 916dc4e3-1bc8-4ba5-b319-d9d0dee54564: rpc.has_security_group_logging(os_id): False [ 1006.250726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.250943] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.251207] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.251348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.251416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.251581] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.251677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.251786] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.251870] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.263910] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.264169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.264303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.264513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.264628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.268952] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.269129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.269219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.269446] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.269645] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.269834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.269963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.270160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.270322] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.270452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.270643] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.270790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.270873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.271040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.271136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.271302] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.271393] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.271489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.271657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.271820] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.271934] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.272022] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.272187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.272282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.272506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.272618] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.274424] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.274707] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.274858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.274948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.275129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.275241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.275354] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 is going to be updated. [ 1006.277947] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.278094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.278189] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.278430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.284319] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5573ccf-d866-40ac-9bb4-1fa04e91ef9c: rpc.has_security_group_logging(os_id): False [ 1006.287145] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1006.287536] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.287536] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.287719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.287905] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.288030] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.288094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.288242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.288328] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.288411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.288496] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.301391] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.301519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.303089] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.303089] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.303089] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.303089] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.303300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.303331] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.303434] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.303503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.303701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.303853] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.303950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.304059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.304220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.304306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.304394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.304548] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.304641] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.304702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.304846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.304922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.305061] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.305153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.305215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.305354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.305488] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.305579] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.305663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.305892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.305981] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.306126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.306230] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.307859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.308112] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.308221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.308289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.308447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.308529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.308754] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.308856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.308922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.309071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.309150] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.309346] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.309429] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.309493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.309672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.309730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.309820] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 is going to be updated. [ 1006.311709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.311709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.313899] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.313899] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.315829] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5233168b-5f93-4bb0-bac2-dd279d965d46: rpc.has_security_group_logging(os_id): False [ 1006.339678] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.339832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.343969] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.344271] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.344396] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.344497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.344714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.344799] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.345014] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.345115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.345181] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.345332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.345408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.345585] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.345669] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.345734] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.345875] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.345952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.346061] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c is going to be updated. [ 1006.347243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.347412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.347565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.348589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.348754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.350490] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.350590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.368250] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1266a9f5-7050-4473-ad65-329e9724ea7d in Status: IN_PROGRESS for 2s [ 1006.381151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.381422] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.381546] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.381613] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.381893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.382008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.382237] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.382335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.382401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.382570] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.382646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.382846] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.382922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.382981] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.383124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.383198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.383279] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1006.384560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.384728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.384873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.420545] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 in Status: IN_PROGRESS for 2s [ 1006.472143] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.472457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.472606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.473025] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.473298] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.477429] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 in Status: SUCCESS [ 1006.477841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.479270] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d193cbd-452d-400d-b88e-58fc27978848 in Status: SUCCESS [ 1006.479575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.483492] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.484441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.484635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.484930] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.485204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.491535] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c in Status: IN_PROGRESS for 2s [ 1006.517453] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 in Status: IN_PROGRESS for 2s [ 1006.518582] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.518880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1006.519040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1006.519332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1006.519574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1006.531622] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1008.382506] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1266a9f5-7050-4473-ad65-329e9724ea7d in Status: SUCCESS [ 1008.382814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1008.434560] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 in Status: SUCCESS [ 1008.434812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1008.505332] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c in Status: SUCCESS [ 1008.505574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1008.540913] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 in Status: SUCCESS [ 1008.541199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1008.544325] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1008.544567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1008.670011] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1008.670111] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1009.555215] env[61817]: INFO networking_nsxv3.common.synchronization [None req-43ae307b-a7c0-48c5-abcc-e53f2e2e0efc None None] Enqueued Resource ID: 9a31b2e0-0d63-4e12-8ad1-2347bf698d52 with Priority: HIGHEST for action port [ 1009.555458] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a31b2e0-0d63-4e12-8ad1-2347bf698d52 with Priority: HIGHEST for action port [ 1009.556052] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.556175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1009.556239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1009.556433] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1009.556510] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1009.556662] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a31b2e0-0d63-4e12-8ad1-2347bf698d52 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.556745] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a31b2e0-0d63-4e12-8ad1-2347bf698d52" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1009.556802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a31b2e0-0d63-4e12-8ad1-2347bf698d52" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1009.556992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a31b2e0-0d63-4e12-8ad1-2347bf698d52" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1009.557068] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a31b2e0-0d63-4e12-8ad1-2347bf698d52',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.650920] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a31b2e0-0d63-4e12-8ad1-2347bf698d52 [ 1009.651156] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.651276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1009.651363] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1009.651541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1009.651646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1009.651738] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a31b2e0-0d63-4e12-8ad1-2347bf698d52 already deleted. [ 1009.651852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a31b2e0-0d63-4e12-8ad1-2347bf698d52" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1011.200051] env[61817]: INFO networking_nsxv3.common.synchronization [None req-454798ce-fa05-4835-8704-79e2bf12bed3 tempest-ServersTestBootFromVolume-333976937 tempest-ServersTestBootFromVolume-333976937-project-member] Enqueued Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGHEST for action security_group_rules [ 1011.200568] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGHEST for action security_group_rules [ 1011.200917] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.201037] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1011.201101] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1011.201298] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1011.201379] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1011.201527] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-627ba6ea-f974-4510-aa7b-1807964b9b40 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.201618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1011.201679] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1011.201881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1011.201957] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('627ba6ea-f974-4510-aa7b-1807964b9b40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.242142] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.242308] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1011.242377] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1011.242599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1011.242701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1011.242863] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 already deleted. [ 1011.242900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1011.440600] env[61817]: INFO networking_nsxv3.common.synchronization [None req-2bd45390-f742-4952-8774-d6390d42782b tempest-ServersTestBootFromVolume-333976937 tempest-ServersTestBootFromVolume-333976937-project-member] Enqueued Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGHEST for action security_group_rules [ 1011.441324] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGHEST for action security_group_rules [ 1011.441647] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.441871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1011.442046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1011.442352] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1011.442441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1011.443414] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-627ba6ea-f974-4510-aa7b-1807964b9b40 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.443708] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1011.443708] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1011.443782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1011.443875] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('627ba6ea-f974-4510-aa7b-1807964b9b40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.475451] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.475608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1011.475693] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1011.475904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1011.475997] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1011.476110] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 already deleted. [ 1011.476193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1012.055936] env[61817]: INFO networking_nsxv3.common.synchronization [None req-d2562142-40b3-4a24-9bf8-e8baa29e52dc None None] Enqueued Resource ID: 00b6b4ea-ec52-46d0-b85a-347f8569795d with Priority: HIGHEST for action port [ 1012.056217] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b6b4ea-ec52-46d0-b85a-347f8569795d with Priority: HIGHEST for action port [ 1012.056797] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.056950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1012.057007] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1012.057185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1012.057274] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1012.057423] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-00b6b4ea-ec52-46d0-b85a-347f8569795d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.057602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00b6b4ea-ec52-46d0-b85a-347f8569795d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1012.057602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00b6b4ea-ec52-46d0-b85a-347f8569795d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1012.057772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00b6b4ea-ec52-46d0-b85a-347f8569795d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1012.057853] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00b6b4ea-ec52-46d0-b85a-347f8569795d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.066760] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00b6b4ea-ec52-46d0-b85a-347f8569795d [ 1012.067021] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.067173] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1012.067285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1012.067497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1012.068059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1012.068218] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00b6b4ea-ec52-46d0-b85a-347f8569795d already deleted. [ 1012.068338] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00b6b4ea-ec52-46d0-b85a-347f8569795d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1013.301169] env[61817]: INFO networking_nsxv3.common.synchronization [None req-9e4e4a41-3449-451e-92ca-1ba292f05344 None None] Enqueued Resource ID: 137d8729-8854-4f40-b726-d15218694376 with Priority: HIGHEST for action port [ 1013.301169] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137d8729-8854-4f40-b726-d15218694376 with Priority: HIGHEST for action port [ 1013.301549] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.301679] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1013.301768] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1013.301980] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1013.302065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1013.302222] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-137d8729-8854-4f40-b726-d15218694376 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.302317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-137d8729-8854-4f40-b726-d15218694376" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1013.302375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-137d8729-8854-4f40-b726-d15218694376" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1013.302566] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-137d8729-8854-4f40-b726-d15218694376" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1013.302644] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('137d8729-8854-4f40-b726-d15218694376',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.360504] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 137d8729-8854-4f40-b726-d15218694376 [ 1013.360991] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.360991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1013.360991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1013.361160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1013.361247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1013.361336] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:137d8729-8854-4f40-b726-d15218694376 already deleted. [ 1013.361431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-137d8729-8854-4f40-b726-d15218694376" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1014.335522] env[61817]: INFO networking_nsxv3.common.synchronization [None req-6796af08-456d-4001-8809-b02c9cc9cfbb None None] Enqueued Resource ID: 1d1f7df8-0bdd-4b99-b47b-d305ba7cf101 with Priority: HIGHEST for action port [ 1014.335809] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d1f7df8-0bdd-4b99-b47b-d305ba7cf101 with Priority: HIGHEST for action port [ 1014.336392] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.336518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1014.336604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1014.336862] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1014.336952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1014.337103] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d1f7df8-0bdd-4b99-b47b-d305ba7cf101 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.337221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d1f7df8-0bdd-4b99-b47b-d305ba7cf101" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1014.337272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d1f7df8-0bdd-4b99-b47b-d305ba7cf101" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1014.337459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d1f7df8-0bdd-4b99-b47b-d305ba7cf101" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1014.337536] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d1f7df8-0bdd-4b99-b47b-d305ba7cf101',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.348562] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d1f7df8-0bdd-4b99-b47b-d305ba7cf101 [ 1014.348776] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.348905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1014.348970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1014.349177] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1014.349265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1014.349352] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d1f7df8-0bdd-4b99-b47b-d305ba7cf101 already deleted. [ 1014.349429] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d1f7df8-0bdd-4b99-b47b-d305ba7cf101" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1015.716095] env[61817]: INFO networking_nsxv3.common.synchronization [None req-7eea5675-824e-4b2a-a7f1-286d5833f81e None None] Enqueued Resource ID: b3a60214-862c-47ad-a3b9-b5307d360ca0 with Priority: HIGHEST for action port [ 1015.716360] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a60214-862c-47ad-a3b9-b5307d360ca0 with Priority: HIGHEST for action port [ 1015.716943] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.717060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1015.717126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1015.717327] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1015.717408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1015.717553] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3a60214-862c-47ad-a3b9-b5307d360ca0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.717641] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3a60214-862c-47ad-a3b9-b5307d360ca0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1015.717698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3a60214-862c-47ad-a3b9-b5307d360ca0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1015.717888] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3a60214-862c-47ad-a3b9-b5307d360ca0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1015.717966] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3a60214-862c-47ad-a3b9-b5307d360ca0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.779861] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3a60214-862c-47ad-a3b9-b5307d360ca0 [ 1015.780114] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.780243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1015.780415] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1015.780518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1015.780607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1015.780784] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3a60214-862c-47ad-a3b9-b5307d360ca0 already deleted. [ 1015.780870] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3a60214-862c-47ad-a3b9-b5307d360ca0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1016.979984] env[61817]: INFO networking_nsxv3.common.synchronization [None req-2451c500-f79c-48ab-be22-005dcbd0beeb None None] Enqueued Resource ID: 0599d92c-f8a2-4f0d-8885-6c17c9a6d7f9 with Priority: HIGHEST for action port [ 1016.980582] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0599d92c-f8a2-4f0d-8885-6c17c9a6d7f9 with Priority: HIGHEST for action port [ 1016.981041] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.981145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1016.981145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1016.981352] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1016.981440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1016.981594] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-0599d92c-f8a2-4f0d-8885-6c17c9a6d7f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.981700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0599d92c-f8a2-4f0d-8885-6c17c9a6d7f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1016.981795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0599d92c-f8a2-4f0d-8885-6c17c9a6d7f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1016.982016] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0599d92c-f8a2-4f0d-8885-6c17c9a6d7f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1016.982101] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0599d92c-f8a2-4f0d-8885-6c17c9a6d7f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.992030] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0599d92c-f8a2-4f0d-8885-6c17c9a6d7f9 [ 1016.992610] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.992856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1016.992972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1016.993222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1016.993348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1016.993484] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0599d92c-f8a2-4f0d-8885-6c17c9a6d7f9 already deleted. [ 1016.993592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0599d92c-f8a2-4f0d-8885-6c17c9a6d7f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1021.981641] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1021.982002] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1026.983036] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1026.983456] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1027.529647] env[61817]: INFO networking_nsxv3.common.synchronization [req-d4759bab-05e0-4783-b926-37c5813981aa req-d4b6bfd4-1234-4bb4-b208-f6e7efc38fd8 tempest-ServerActionsTestOtherA-130325156 tempest-ServerActionsTestOtherA-130325156-project-member] Enqueued Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGHEST for action security_group_members [ 1027.529647] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGHEST for action security_group_members [ 1027.529647] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.529647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1027.529647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1027.529647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1027.529647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1027.529647] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.529647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1027.529647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1027.529647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1027.529647] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.529647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1027.529647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1027.529647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1027.529647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1027.529647] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.537896] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.537896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1027.537896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1027.538186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1027.538186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1027.538771] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.538771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1027.538771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1027.539031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1027.539176] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1027.539312] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1266a9f5-7050-4473-ad65-329e9724ea7d is going to be updated. [ 1027.571465] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.571465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1027.571465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1027.571465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1027.571465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1027.580754] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1266a9f5-7050-4473-ad65-329e9724ea7d in Status: IN_PROGRESS for 2s [ 1029.596587] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1266a9f5-7050-4473-ad65-329e9724ea7d in Status: SUCCESS [ 1029.596587] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1266a9f5-7050-4473-ad65-329e9724ea7d deletion is rescheduled due to dependency. [ 1029.596587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1032.525564] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1032.525814] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1032.841620] env[61817]: INFO networking_nsxv3.common.synchronization [req-b7fc176f-169c-447a-aa19-d85bcc732076 req-fe6e4dd9-3344-4105-85c3-32e2ca9f8e83 tempest-ServersTestJSON-1722207346 tempest-ServersTestJSON-1722207346-project-member] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1032.842148] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1032.842453] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.842572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1032.842641] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1032.842887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1032.842967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1032.843148] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.843254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1032.843313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1032.843531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1032.843707] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.843860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1032.843909] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1032.844258] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1032.844374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1032.844496] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.862532] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.862532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1032.862532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1032.862532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1032.862532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1032.862532] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.862532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1032.862532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1032.862532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1032.862532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1032.862532] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd already deleted. [ 1032.862532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1033.548424] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.548748] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1033.548973] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1033.549264] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1033.549423] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1033.549690] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-463 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.549857] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1033.549980] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1033.550262] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1033.550524] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.550759] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1033.550978] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1033.551217] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1033.551372] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1033.551530] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1033.551865] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.552141] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1033.552313] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1033.552573] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1033.552913] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1033.553221] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-3a77fa6f-8925-4ad5-8f96-8def9d915ecd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.553411] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-3a77fa6f-8925-4ad5-8f96-8def9d915ecd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1033.553563] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-3a77fa6f-8925-4ad5-8f96-8def9d915ecd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1033.553945] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-3a77fa6f-8925-4ad5-8f96-8def9d915ecd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1033.554125] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a77fa6f-8925-4ad5-8f96-8def9d915ecd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.569128] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.569307] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1033.569442] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1033.569715] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1033.569871] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1033.570028] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 3a77fa6f-8925-4ad5-8f96-8def9d915ecd not found, creating... [ 1033.570305] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.570460] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1033.570574] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1033.570838] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1033.570995] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1033.571280] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.571446] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1033.571597] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1033.571877] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1033.572061] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1033.572188] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 3a77fa6f-8925-4ad5-8f96-8def9d915ecd is going to be created. [ 1033.598471] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.598863] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1033.599102] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1033.599424] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1033.599735] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1033.600054] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-3a77fa6f-8925-4ad5-8f96-8def9d915ecd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1034.310417] env[61817]: INFO networking_nsxv3.common.synchronization [req-b7fc176f-169c-447a-aa19-d85bcc732076 req-aa62f1ed-36f0-48d6-aa66-2084934d4daf service neutron] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_rules [ 1034.310690] env[61817]: INFO networking_nsxv3.common.synchronization [req-b7fc176f-169c-447a-aa19-d85bcc732076 req-aa62f1ed-36f0-48d6-aa66-2084934d4daf service neutron] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1034.310824] env[61817]: INFO networking_nsxv3.common.synchronization [req-b7fc176f-169c-447a-aa19-d85bcc732076 req-aa62f1ed-36f0-48d6-aa66-2084934d4daf service neutron] Enqueued Resource ID: 3a77fa6f-8925-4ad5-8f96-8def9d915ecd with Priority: HIGHEST for action port [ 1034.311376] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_rules [ 1034.311510] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1034.311604] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a77fa6f-8925-4ad5-8f96-8def9d915ecd with Priority: HIGHEST for action port [ 1034.311910] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.312055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.312121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.312305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.312385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1034.312536] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.312636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.312699] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.312873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.313077] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.314251] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.317471] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.317586] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.317769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.317851] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1034.318000] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.318093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.318155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.318298] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.318435] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.318523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.319104] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.319104] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.319104] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1034.319104] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.320153] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.320251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.320251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.320407] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.320475] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1034.320612] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a77fa6f-8925-4ad5-8f96-8def9d915ecd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.320858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a77fa6f-8925-4ad5-8f96-8def9d915ecd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.320858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a77fa6f-8925-4ad5-8f96-8def9d915ecd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.320940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a77fa6f-8925-4ad5-8f96-8def9d915ecd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.321005] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a77fa6f-8925-4ad5-8f96-8def9d915ecd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.344554] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a77fa6f-8925-4ad5-8f96-8def9d915ecd with status ACTIVE [ 1034.344769] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.344894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.344960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.345178] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.345264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1034.345436] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.345529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.345589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.345733] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.345806] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1034.347073] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.347177] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.347240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.347387] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.347461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1034.347603] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.347684] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.347838] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.365460] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.374412] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.374617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.374712] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.374980] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.375088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1034.375193] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be created. [ 1034.406591] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.406591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.406591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.406591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.406591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1034.415748] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: UNINITIALIZED for 2s [ 1034.764772] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.765077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.765077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.765153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.765234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1034.765329] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a77fa6f-8925-4ad5-8f96-8def9d915ecd is going to be updated. [ 1034.787090] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.787232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1034.787299] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1034.787506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1034.787653] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1034.787810] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a77fa6f-8925-4ad5-8f96-8def9d915ecd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1035.692083] env[61817]: INFO networking_nsxv3.common.synchronization [None req-9717b8aa-da1b-4ae2-bb55-1ebb945093bf tempest-AttachVolumeNegativeTest-329748670 tempest-AttachVolumeNegativeTest-329748670-project-member] Enqueued Resource ID: e2cf8927-f4c8-483c-9069-b555fa56e11f with Priority: HIGHEST for action security_group_rules [ 1035.692083] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2cf8927-f4c8-483c-9069-b555fa56e11f with Priority: HIGHEST for action security_group_rules [ 1035.692083] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.692083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1035.692083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1035.692083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1035.692083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1035.692083] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2cf8927-f4c8-483c-9069-b555fa56e11f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.692083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2cf8927-f4c8-483c-9069-b555fa56e11f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1035.692083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2cf8927-f4c8-483c-9069-b555fa56e11f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1035.692083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2cf8927-f4c8-483c-9069-b555fa56e11f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1035.692083] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2cf8927-f4c8-483c-9069-b555fa56e11f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.725169] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.725636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1035.725822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1035.726216] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1035.726450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1035.726641] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2cf8927-f4c8-483c-9069-b555fa56e11f already deleted. [ 1035.726827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2cf8927-f4c8-483c-9069-b555fa56e11f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1035.848275] env[61817]: INFO networking_nsxv3.common.synchronization [None req-d8d7e23b-5162-4fe9-8975-3cb9bc436d44 tempest-AttachVolumeNegativeTest-329748670 tempest-AttachVolumeNegativeTest-329748670-project-member] Enqueued Resource ID: e2cf8927-f4c8-483c-9069-b555fa56e11f with Priority: HIGHEST for action security_group_rules [ 1035.848275] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2cf8927-f4c8-483c-9069-b555fa56e11f with Priority: HIGHEST for action security_group_rules [ 1035.848275] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.848275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1035.848275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1035.848275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1035.848275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1035.848275] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2cf8927-f4c8-483c-9069-b555fa56e11f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.848275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2cf8927-f4c8-483c-9069-b555fa56e11f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1035.848275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2cf8927-f4c8-483c-9069-b555fa56e11f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1035.848275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2cf8927-f4c8-483c-9069-b555fa56e11f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1035.848275] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2cf8927-f4c8-483c-9069-b555fa56e11f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.877839] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.878304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1035.878484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1035.878901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1035.879433] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1035.879651] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2cf8927-f4c8-483c-9069-b555fa56e11f already deleted. [ 1035.879845] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2cf8927-f4c8-483c-9069-b555fa56e11f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.428040] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 1036.428040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.428040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.428040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.428040] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.428040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1036.428040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.428040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.428040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.428040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.428040] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.436116] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.436266] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1036.436337] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.436525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.436603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.436762] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.436859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1036.436921] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.437072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.437272] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.437372] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1036.437434] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.437577] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.437657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.437737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.437886] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.437977] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1036.438037] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.438174] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.438245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.438381] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.438471] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1036.438533] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.438709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.438805] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.438894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1036.438953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.439085] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.439159] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.439237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.439325] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.454204] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ffcb57e-8678-415b-bd13-19b60dbd45bd: rpc.has_security_group_logging(os_id): False [ 1036.474098] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.474333] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1036.474333] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.474521] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.474614] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.474818] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.474943] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1036.475034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.475157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.475236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.475433] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.475528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1036.475588] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.475731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.475808] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.476017] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.476098] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1036.476164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.476302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.476465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.476465] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be created. [ 1036.538224] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.538402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1036.538459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1036.538678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1036.538894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1036.556841] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 1038.570565] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 1038.570969] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1040.846522] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1040.846856] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1045.847720] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1045.847987] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1050.849046] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1050.849416] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1051.138702] env[61817]: INFO networking_nsxv3.common.synchronization [None req-5fc358d9-26a6-40f3-8daa-46d0c5b324f9 tempest-TaggedBootDevicesTest_v242-294738673 tempest-TaggedBootDevicesTest_v242-294738673-project-member] Enqueued Resource ID: bfa1482d-8383-460c-8989-a3332cbb46d0 with Priority: HIGHEST for action security_group_members [ 1051.138702] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfa1482d-8383-460c-8989-a3332cbb46d0 with Priority: HIGHEST for action security_group_members [ 1051.138702] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.138702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1051.138702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1051.138702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1051.138702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1051.138702] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfa1482d-8383-460c-8989-a3332cbb46d0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.138702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1051.138702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1051.138702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1051.138702] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.138702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1051.138702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1051.138702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1051.138702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1051.138702] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfa1482d-8383-460c-8989-a3332cbb46d0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.146404] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.146585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1051.146631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1051.146864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1051.146967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1051.147167] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.147277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1051.147372] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1051.147550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1051.147644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1051.147739] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfa1482d-8383-460c-8989-a3332cbb46d0 already deleted. [ 1051.147819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1051.455231] env[61817]: INFO networking_nsxv3.common.synchronization [None req-0814f4b9-72c7-4932-bd88-427e6458c578 tempest-TaggedBootDevicesTest_v242-294738673 tempest-TaggedBootDevicesTest_v242-294738673-project-member] Enqueued Resource ID: bfa1482d-8383-460c-8989-a3332cbb46d0 with Priority: HIGHEST for action security_group_members [ 1051.456020] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfa1482d-8383-460c-8989-a3332cbb46d0 with Priority: HIGHEST for action security_group_members [ 1051.456108] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.456171] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1051.456259] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1051.456422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1051.456503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1051.456649] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfa1482d-8383-460c-8989-a3332cbb46d0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.456747] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1051.456805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1051.456953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1051.457114] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.457192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1051.457261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1051.457467] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1051.457548] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1051.457635] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfa1482d-8383-460c-8989-a3332cbb46d0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.470859] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.471008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1051.471076] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1051.471269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1051.471357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1051.471542] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.471629] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1051.471773] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1051.471827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1051.471899] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1051.471979] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfa1482d-8383-460c-8989-a3332cbb46d0 already deleted. [ 1051.472066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfa1482d-8383-460c-8989-a3332cbb46d0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1054.947052] env[61817]: INFO networking_nsxv3.common.synchronization [None req-962bd3e4-ee0c-4dca-906a-44f4f88d4984 tempest-AttachInterfacesTestJSON-327680650 tempest-AttachInterfacesTestJSON-327680650-project-member] Enqueued Resource ID: e347f6ad-b33e-466b-ad02-d219343e631a with Priority: HIGHEST for action security_group_rules [ 1054.947595] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e347f6ad-b33e-466b-ad02-d219343e631a with Priority: HIGHEST for action security_group_rules [ 1054.947902] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.948046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1054.948120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1054.948328] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1054.948420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1054.948610] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e347f6ad-b33e-466b-ad02-d219343e631a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.948716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e347f6ad-b33e-466b-ad02-d219343e631a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1054.948755] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e347f6ad-b33e-466b-ad02-d219343e631a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1054.948955] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e347f6ad-b33e-466b-ad02-d219343e631a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1054.949040] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e347f6ad-b33e-466b-ad02-d219343e631a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.983344] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.983503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1054.983584] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1054.983783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1054.983885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1054.983989] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e347f6ad-b33e-466b-ad02-d219343e631a already deleted. [ 1054.984105] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e347f6ad-b33e-466b-ad02-d219343e631a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1055.175819] env[61817]: INFO networking_nsxv3.common.synchronization [None req-68cfccfe-e54c-4cd1-84a2-1d8a691cfe81 tempest-AttachInterfacesTestJSON-327680650 tempest-AttachInterfacesTestJSON-327680650-project-member] Enqueued Resource ID: e347f6ad-b33e-466b-ad02-d219343e631a with Priority: HIGHEST for action security_group_rules [ 1055.176236] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e347f6ad-b33e-466b-ad02-d219343e631a with Priority: HIGHEST for action security_group_rules [ 1055.176551] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.176667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1055.176730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1055.176928] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1055.177001] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1055.177145] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e347f6ad-b33e-466b-ad02-d219343e631a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.177233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e347f6ad-b33e-466b-ad02-d219343e631a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1055.177291] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e347f6ad-b33e-466b-ad02-d219343e631a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1055.177431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e347f6ad-b33e-466b-ad02-d219343e631a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1055.177815] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e347f6ad-b33e-466b-ad02-d219343e631a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.215703] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.215703] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1055.215918] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1055.215955] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1055.216132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1055.216191] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e347f6ad-b33e-466b-ad02-d219343e631a already deleted. [ 1055.216227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e347f6ad-b33e-466b-ad02-d219343e631a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1057.545164] env[61817]: INFO networking_nsxv3.common.synchronization [None req-2b015c54-5347-4803-a783-7e648bfcc019 None None] Enqueued Resource ID: 6fcf3342-5e30-4207-95a0-7dfc2fe1bfe6 with Priority: HIGHEST for action port [ 1057.545439] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fcf3342-5e30-4207-95a0-7dfc2fe1bfe6 with Priority: HIGHEST for action port [ 1057.546325] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.546447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1057.546512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1057.546707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1057.546793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1057.546943] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fcf3342-5e30-4207-95a0-7dfc2fe1bfe6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.547034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fcf3342-5e30-4207-95a0-7dfc2fe1bfe6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1057.547094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fcf3342-5e30-4207-95a0-7dfc2fe1bfe6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1057.547280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fcf3342-5e30-4207-95a0-7dfc2fe1bfe6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1057.547361] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fcf3342-5e30-4207-95a0-7dfc2fe1bfe6',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.569711] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fcf3342-5e30-4207-95a0-7dfc2fe1bfe6 [ 1057.569805] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.569919] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1057.569965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1057.570155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1057.570247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1057.570340] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fcf3342-5e30-4207-95a0-7dfc2fe1bfe6 already deleted. [ 1057.570420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fcf3342-5e30-4207-95a0-7dfc2fe1bfe6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1058.588483] env[61817]: INFO networking_nsxv3.common.synchronization [None req-3b60065a-b4f8-4f56-b323-ac3352c6bda6 tempest-ServerActionsV293TestJSON-1559847917 tempest-ServerActionsV293TestJSON-1559847917-project-member] Enqueued Resource ID: 911f1009-71f9-4e68-84e0-72cf8916d896 with Priority: HIGHEST for action security_group_rules [ 1058.589061] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 911f1009-71f9-4e68-84e0-72cf8916d896 with Priority: HIGHEST for action security_group_rules [ 1058.589375] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.589495] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1058.589558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1058.589754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1058.589836] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1058.589988] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-911f1009-71f9-4e68-84e0-72cf8916d896 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.590079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-911f1009-71f9-4e68-84e0-72cf8916d896" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1058.590138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-911f1009-71f9-4e68-84e0-72cf8916d896" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1058.590329] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-911f1009-71f9-4e68-84e0-72cf8916d896" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1058.590406] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('911f1009-71f9-4e68-84e0-72cf8916d896',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.629825] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.629968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1058.630043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1058.630259] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1058.630353] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1058.630444] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 911f1009-71f9-4e68-84e0-72cf8916d896 already deleted. [ 1058.630528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-911f1009-71f9-4e68-84e0-72cf8916d896" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1058.778483] env[61817]: INFO networking_nsxv3.common.synchronization [None req-8f4865a6-d8bb-45a2-940f-c86241f55237 tempest-ServerActionsV293TestJSON-1559847917 tempest-ServerActionsV293TestJSON-1559847917-project-member] Enqueued Resource ID: 911f1009-71f9-4e68-84e0-72cf8916d896 with Priority: HIGHEST for action security_group_rules [ 1058.779014] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 911f1009-71f9-4e68-84e0-72cf8916d896 with Priority: HIGHEST for action security_group_rules [ 1058.779334] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.779454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1058.779518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1058.779712] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1058.779790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1058.779931] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-911f1009-71f9-4e68-84e0-72cf8916d896 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.780030] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-911f1009-71f9-4e68-84e0-72cf8916d896" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1058.780088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-911f1009-71f9-4e68-84e0-72cf8916d896" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1058.780227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-911f1009-71f9-4e68-84e0-72cf8916d896" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1058.780453] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('911f1009-71f9-4e68-84e0-72cf8916d896',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.820434] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.820591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1058.820665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1058.821769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1058.821769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1058.821769] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 911f1009-71f9-4e68-84e0-72cf8916d896 already deleted. [ 1058.821769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-911f1009-71f9-4e68-84e0-72cf8916d896" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1059.792142] env[61817]: INFO networking_nsxv3.common.synchronization [None req-6ac3514f-fc2c-4242-8aff-403ce93630ad None None] Enqueued Resource ID: 515abdf3-8e0a-4774-b02c-e5d725e7c61b with Priority: HIGHEST for action port [ 1059.792687] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 515abdf3-8e0a-4774-b02c-e5d725e7c61b with Priority: HIGHEST for action port [ 1059.793007] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.793132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1059.793199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1059.793392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1059.793477] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1059.793623] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-515abdf3-8e0a-4774-b02c-e5d725e7c61b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.793723] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-515abdf3-8e0a-4774-b02c-e5d725e7c61b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1059.793761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-515abdf3-8e0a-4774-b02c-e5d725e7c61b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1059.793953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-515abdf3-8e0a-4774-b02c-e5d725e7c61b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1059.794026] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('515abdf3-8e0a-4774-b02c-e5d725e7c61b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.813557] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 515abdf3-8e0a-4774-b02c-e5d725e7c61b [ 1059.813782] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.813914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1059.814008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1059.814176] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1059.814264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1059.814356] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:515abdf3-8e0a-4774-b02c-e5d725e7c61b already deleted. [ 1059.814434] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-515abdf3-8e0a-4774-b02c-e5d725e7c61b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1059.846059] env[61817]: INFO networking_nsxv3.common.synchronization [None req-a5f53111-5f76-43c3-9701-91c2f882b4e1 None None] Enqueued Resource ID: 144348fb-892e-4cb2-a8c6-9419c9749f5a with Priority: HIGHEST for action port [ 1059.846307] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 144348fb-892e-4cb2-a8c6-9419c9749f5a with Priority: HIGHEST for action port [ 1059.846874] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.847397] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1059.847471] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1059.847672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1059.847764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1059.847940] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-144348fb-892e-4cb2-a8c6-9419c9749f5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.848114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-144348fb-892e-4cb2-a8c6-9419c9749f5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1059.848177] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-144348fb-892e-4cb2-a8c6-9419c9749f5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1059.848416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-144348fb-892e-4cb2-a8c6-9419c9749f5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1059.848499] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('144348fb-892e-4cb2-a8c6-9419c9749f5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.976272] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 144348fb-892e-4cb2-a8c6-9419c9749f5a [ 1059.976511] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.976642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1059.976715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1059.976933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1059.977029] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1059.977126] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:144348fb-892e-4cb2-a8c6-9419c9749f5a already deleted. [ 1059.977206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-144348fb-892e-4cb2-a8c6-9419c9749f5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1060.751511] env[61817]: INFO networking_nsxv3.common.synchronization [None req-67ab351a-a232-4aaf-b9a7-d74f6c9ea0cb tempest-AttachVolumeTestJSON-2111320188 tempest-AttachVolumeTestJSON-2111320188-project-member] Enqueued Resource ID: b4efa945-7971-4ec3-8729-4897f777f44e with Priority: HIGHEST for action security_group_rules [ 1060.752228] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4efa945-7971-4ec3-8729-4897f777f44e with Priority: HIGHEST for action security_group_rules [ 1060.752410] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.752498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1060.752560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1060.752765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1060.752870] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1060.753029] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4efa945-7971-4ec3-8729-4897f777f44e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.753128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4efa945-7971-4ec3-8729-4897f777f44e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1060.753192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4efa945-7971-4ec3-8729-4897f777f44e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1060.753437] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4efa945-7971-4ec3-8729-4897f777f44e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1060.753468] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4efa945-7971-4ec3-8729-4897f777f44e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.792042] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.792042] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1060.792042] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1060.792042] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1060.792042] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1060.792042] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4efa945-7971-4ec3-8729-4897f777f44e already deleted. [ 1060.792042] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4efa945-7971-4ec3-8729-4897f777f44e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1060.847048] env[61817]: INFO networking_nsxv3.common.synchronization [None req-73ac5b19-ce87-4a52-ab8a-42d37ce10bd7 tempest-AttachVolumeTestJSON-2111320188 tempest-AttachVolumeTestJSON-2111320188-project-member] Enqueued Resource ID: b4efa945-7971-4ec3-8729-4897f777f44e with Priority: HIGHEST for action security_group_rules [ 1060.847554] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4efa945-7971-4ec3-8729-4897f777f44e with Priority: HIGHEST for action security_group_rules [ 1060.847858] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.847976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1060.848057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1060.848257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1060.848343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1060.848477] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4efa945-7971-4ec3-8729-4897f777f44e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.848636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4efa945-7971-4ec3-8729-4897f777f44e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1060.848717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4efa945-7971-4ec3-8729-4897f777f44e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1060.848871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4efa945-7971-4ec3-8729-4897f777f44e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1060.848947] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4efa945-7971-4ec3-8729-4897f777f44e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.881289] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.881289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1060.881289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1060.881289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1060.881289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1060.881289] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4efa945-7971-4ec3-8729-4897f777f44e already deleted. [ 1060.881289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4efa945-7971-4ec3-8729-4897f777f44e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.581852] env[61817]: INFO networking_nsxv3.common.synchronization [None req-194b5b49-e563-4ed4-b404-cb4e8f5be483 None None] Enqueued Resource ID: 681183e9-1398-4ddc-bfd9-c161294d9b51 with Priority: HIGHEST for action port [ 1061.581852] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 681183e9-1398-4ddc-bfd9-c161294d9b51 with Priority: HIGHEST for action port [ 1061.581852] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.581852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.581852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.581852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.581852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.581852] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-681183e9-1398-4ddc-bfd9-c161294d9b51 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.581852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-681183e9-1398-4ddc-bfd9-c161294d9b51" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.581852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-681183e9-1398-4ddc-bfd9-c161294d9b51" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.581852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-681183e9-1398-4ddc-bfd9-c161294d9b51" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.581852] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('681183e9-1398-4ddc-bfd9-c161294d9b51',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.590226] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 681183e9-1398-4ddc-bfd9-c161294d9b51 [ 1061.590226] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.590226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1061.590226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1061.590226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1061.590226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1061.590226] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:681183e9-1398-4ddc-bfd9-c161294d9b51 already deleted. [ 1061.590226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-681183e9-1398-4ddc-bfd9-c161294d9b51" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1066.580737] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1066.581011] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1071.581930] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1071.582289] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1076.583201] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1076.583503] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1078.176227] env[61817]: INFO networking_nsxv3.common.synchronization [req-98f9f9ab-af76-495c-afea-16520da4f1c5 req-3dac105d-f61e-4d86-8dbd-cb53ffcdf2c7 tempest-VolumesAssistedSnapshotsTest-1225995952 tempest-VolumesAssistedSnapshotsTest-1225995952-project-member] Enqueued Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGHEST for action security_group_members [ 1078.176227] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGHEST for action security_group_members [ 1078.176227] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.176227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.176227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.176227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.176227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.176227] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.176227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.176227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.176227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.176227] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.176227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.176227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.176227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.176227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.176227] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.192252] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.192447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.192496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.192666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.192759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.192947] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.193065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.193179] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.193346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.193380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.193450] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 is going to be updated. [ 1078.226522] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.226662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1078.226747] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1078.226948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1078.227096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1078.237231] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 in Status: IN_PROGRESS for 2s [ 1080.248941] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 in Status: SUCCESS [ 1080.249306] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 deletion is rescheduled due to dependency. [ 1080.249306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.360138] env[61817]: INFO networking_nsxv3.common.synchronization [req-c6fa9317-8d61-4b3a-858d-58f325837a54 req-19eff503-e248-447f-927e-350af02ddcbf tempest-ServerActionsTestOtherB-280984654 tempest-ServerActionsTestOtherB-280984654-project-member] Enqueued Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGHEST for action security_group_members [ 1080.360138] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGHEST for action security_group_members [ 1080.360138] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.360138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.360138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.360138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.360138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.360138] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.360138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.360138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.360138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.360138] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.360138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.360138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.360626] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.360626] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.360626] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.372511] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.372901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.373030] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.373364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.374362] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.374362] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.374362] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.374513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.375201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.375201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.375201] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a already deleted. [ 1080.375201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.680644] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.680889] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.681025] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.681336] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.681457] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.681704] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-822 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.681877] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-822" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.681976] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-822" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.682244] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-822" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.682493] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.682652] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.682963] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.682963] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.683130] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.683287] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-822" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.683538] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.683699] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.683812] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.684051] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.684168] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.684406] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-44c5408b-eaa3-47b2-86be-e68084f595f5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.684568] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-44c5408b-eaa3-47b2-86be-e68084f595f5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.684698] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-44c5408b-eaa3-47b2-86be-e68084f595f5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.684944] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-44c5408b-eaa3-47b2-86be-e68084f595f5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.685084] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44c5408b-eaa3-47b2-86be-e68084f595f5',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.703751] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.704368] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.704513] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.704781] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.704930] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.705083] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 44c5408b-eaa3-47b2-86be-e68084f595f5 not found, creating... [ 1080.705358] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.705516] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.705632] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.705862] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.706062] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.706276] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.706431] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.706549] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.706756] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.706887] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.707047] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 44c5408b-eaa3-47b2-86be-e68084f595f5 is going to be created. [ 1080.728439] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.728825] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.729007] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.729296] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.729539] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.729777] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-44c5408b-eaa3-47b2-86be-e68084f595f5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.987504] env[61817]: INFO networking_nsxv3.common.synchronization [req-c6fa9317-8d61-4b3a-858d-58f325837a54 req-536b6d25-63e4-4290-8a44-8221c55da10c service neutron] Enqueued Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGHEST for action security_group_rules [ 1080.987625] env[61817]: INFO networking_nsxv3.common.synchronization [req-c6fa9317-8d61-4b3a-858d-58f325837a54 req-536b6d25-63e4-4290-8a44-8221c55da10c service neutron] Enqueued Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGHEST for action security_group_members [ 1080.987767] env[61817]: INFO networking_nsxv3.common.synchronization [req-c6fa9317-8d61-4b3a-858d-58f325837a54 req-536b6d25-63e4-4290-8a44-8221c55da10c service neutron] Enqueued Resource ID: 44c5408b-eaa3-47b2-86be-e68084f595f5 with Priority: HIGHEST for action port [ 1080.987993] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGHEST for action security_group_rules [ 1080.988152] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGHEST for action security_group_members [ 1080.988246] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44c5408b-eaa3-47b2-86be-e68084f595f5 with Priority: HIGHEST for action port [ 1080.989182] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.989339] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.989370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.989560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.989643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.989795] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.989914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.989977] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.990135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.990209] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.991063] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.991167] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.991227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.991375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.991450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.991586] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.991673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.991729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.991890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.992036] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.992127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.992185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.992323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.992458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.992495] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.993205] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.993366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.993366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.993512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.993583] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1080.993757] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-44c5408b-eaa3-47b2-86be-e68084f595f5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.993823] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44c5408b-eaa3-47b2-86be-e68084f595f5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1080.993876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44c5408b-eaa3-47b2-86be-e68084f595f5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1080.994008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44c5408b-eaa3-47b2-86be-e68084f595f5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1080.994076] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44c5408b-eaa3-47b2-86be-e68084f595f5',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.012482] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.027103] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.027243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1081.027329] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1081.027527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1081.027614] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1081.027909] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.027909] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1081.028521] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.029838] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44c5408b-eaa3-47b2-86be-e68084f595f5 with status ACTIVE [ 1081.030004] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.030104] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1081.030171] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1081.030334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1081.030412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1081.030569] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.030659] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1081.030793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1081.030947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1081.031021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1081.035686] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.035808] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1081.035868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1081.036053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1081.036138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1081.036226] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a is going to be created. [ 1081.059538] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.059538] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1081.059538] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1081.059538] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1081.059799] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1081.075440] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a in Status: UNINITIALIZED for 2s [ 1081.424020] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.424407] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1081.424407] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1081.424496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1081.424600] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1081.424701] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44c5408b-eaa3-47b2-86be-e68084f595f5 is going to be updated. [ 1081.447342] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.447561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1081.447561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1081.447807] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1081.447974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1081.448160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44c5408b-eaa3-47b2-86be-e68084f595f5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1083.085760] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a in Status: SUCCESS [ 1083.086029] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1083.086166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1083.086336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1083.086521] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.086631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1083.086700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1083.086846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1083.086923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1083.087003] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1083.087088] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.098054] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.104539] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3ac00c4-e41d-4288-b6b9-01b5f4714e5a: rpc.has_security_group_logging(os_id): False [ 1083.121965] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.122168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1083.122168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1083.122375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1083.122463] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1083.122702] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.122792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1083.122854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1083.123034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1083.123078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1083.123155] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a is going to be created. [ 1083.188090] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.188308] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1083.188308] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1083.188518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1083.188740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1083.200911] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a in Status: IN_PROGRESS for 2s [ 1085.175232] env[61817]: INFO networking_nsxv3.common.synchronization [None req-ba5f3f43-4712-4ce2-b461-2bb5423c8c88 None None] Enqueued Resource ID: 51d64479-1031-4763-8d7b-1a204a093c6c with Priority: HIGHEST for action port [ 1085.175772] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d64479-1031-4763-8d7b-1a204a093c6c with Priority: HIGHEST for action port [ 1085.176108] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.176245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1085.176299] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1085.176502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1085.176598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1085.176754] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-51d64479-1031-4763-8d7b-1a204a093c6c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.176855] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51d64479-1031-4763-8d7b-1a204a093c6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1085.176917] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51d64479-1031-4763-8d7b-1a204a093c6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1085.177233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51d64479-1031-4763-8d7b-1a204a093c6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1085.177233] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51d64479-1031-4763-8d7b-1a204a093c6c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.211114] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51d64479-1031-4763-8d7b-1a204a093c6c [ 1085.211114] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.211114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1085.211114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1085.211114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1085.211114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1085.211114] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51d64479-1031-4763-8d7b-1a204a093c6c already deleted. [ 1085.211114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51d64479-1031-4763-8d7b-1a204a093c6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1085.215550] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a in Status: SUCCESS [ 1085.215550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1086.488893] env[61817]: INFO networking_nsxv3.common.synchronization [req-b7fc176f-169c-447a-aa19-d85bcc732076 req-01785d48-3a92-4721-8270-5de9d204b50d tempest-ServersTestJSON-1722207346 tempest-ServersTestJSON-1722207346-project-member] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1086.489423] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1086.489721] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.489868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1086.489933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1086.490143] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1086.490239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1086.490411] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.490527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1086.490606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1086.490828] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1086.490949] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.491045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1086.491108] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1086.491256] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1086.491333] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1086.491421] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.514290] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.520039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1086.520039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1086.520039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1086.520039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1086.520039] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.520039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1086.520039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1086.520039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1086.520039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1086.520039] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be updated. [ 1086.544911] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.545052] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1086.545116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1086.545317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1086.545461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1086.554536] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 1088.243943] env[61817]: INFO networking_nsxv3.common.synchronization [req-56c681d0-adc0-46c1-88a4-803b466c34e0 req-4a187cf6-9036-4829-b860-05e1902ad408 tempest-InstanceActionsV221TestJSON-1625642940 tempest-InstanceActionsV221TestJSON-1625642940-project-member] Enqueued Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGHEST for action security_group_members [ 1088.244364] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGHEST for action security_group_members [ 1088.244788] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.244947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.245069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.245293] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.245415] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.245630] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.245745] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.245876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.246154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.246387] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.246458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.246490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.246614] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.246696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.246785] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.256521] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.256652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.256652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.256793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.256920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.257096] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.257188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.257245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.257386] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.257451] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.257533] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b already deleted. [ 1088.257606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.557233] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.557233] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.557233] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.557233] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.557233] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.557233] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-731 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.557233] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-731" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.557233] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-731" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.557233] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-731" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.558815] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.558815] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.558815] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.558815] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.558815] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.558815] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-731" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.558815] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.558815] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.558815] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.558815] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.558815] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.559510] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-151de087-3a41-4b53-b6d8-acc5a00d9c10 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.559510] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-151de087-3a41-4b53-b6d8-acc5a00d9c10" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.559510] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-151de087-3a41-4b53-b6d8-acc5a00d9c10" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.559510] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-151de087-3a41-4b53-b6d8-acc5a00d9c10" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.559510] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('151de087-3a41-4b53-b6d8-acc5a00d9c10',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.573224] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 1088.573429] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd deletion is rescheduled due to dependency. [ 1088.573555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.585842] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.586067] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.586197] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.586472] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.586627] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.586780] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 151de087-3a41-4b53-b6d8-acc5a00d9c10 not found, creating... [ 1088.587035] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.587190] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.587308] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.587529] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.587702] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.587982] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.588156] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.588279] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.588519] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.588679] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.588824] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 151de087-3a41-4b53-b6d8-acc5a00d9c10 is going to be created. [ 1088.610413] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.610630] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.610809] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.611295] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.611482] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.611546] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-151de087-3a41-4b53-b6d8-acc5a00d9c10" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.846336] env[61817]: INFO networking_nsxv3.common.synchronization [req-56c681d0-adc0-46c1-88a4-803b466c34e0 req-c8660a1f-56ce-4b4a-800b-81f1b3ec4206 service neutron] Enqueued Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGHEST for action security_group_rules [ 1088.846336] env[61817]: INFO networking_nsxv3.common.synchronization [req-56c681d0-adc0-46c1-88a4-803b466c34e0 req-c8660a1f-56ce-4b4a-800b-81f1b3ec4206 service neutron] Enqueued Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGHEST for action security_group_members [ 1088.846336] env[61817]: INFO networking_nsxv3.common.synchronization [req-56c681d0-adc0-46c1-88a4-803b466c34e0 req-c8660a1f-56ce-4b4a-800b-81f1b3ec4206 service neutron] Enqueued Resource ID: 151de087-3a41-4b53-b6d8-acc5a00d9c10 with Priority: HIGHEST for action port [ 1088.846336] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGHEST for action security_group_rules [ 1088.846336] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGHEST for action security_group_members [ 1088.846336] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 151de087-3a41-4b53-b6d8-acc5a00d9c10 with Priority: HIGHEST for action port [ 1088.846336] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.846336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.846336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.846336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.846336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.846336] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.846336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.846336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.846336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.846336] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.847430] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.847430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.847430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.847430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.847430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.847430] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.849661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.849661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.849661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.849661] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.849661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.849661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.849661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.849661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.849661] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.849951] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.849951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.849951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.850064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.850099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.851306] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-151de087-3a41-4b53-b6d8-acc5a00d9c10 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.851306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-151de087-3a41-4b53-b6d8-acc5a00d9c10" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.851306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-151de087-3a41-4b53-b6d8-acc5a00d9c10" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.851306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-151de087-3a41-4b53-b6d8-acc5a00d9c10" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.851306] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('151de087-3a41-4b53-b6d8-acc5a00d9c10',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.874250] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.885462] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.885603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.885674] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.885870] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.885957] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.886151] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.886242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.890911] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.900586] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.900740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.900805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.901005] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.901100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.901196] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b is going to be created. [ 1088.905310] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 151de087-3a41-4b53-b6d8-acc5a00d9c10 with status ACTIVE [ 1088.905507] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.905625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.905691] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.905875] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.905961] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.906122] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.906219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.906280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.906430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.906504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.925965] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.926144] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1088.926231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1088.926481] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1088.926688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1088.941461] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b in Status: UNINITIALIZED for 2s [ 1089.390769] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.391114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1089.391114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1089.391246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1089.391352] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1089.391450] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 151de087-3a41-4b53-b6d8-acc5a00d9c10 is going to be updated. [ 1089.413486] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.413707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1089.413707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1089.413900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1089.414057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1089.414225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-151de087-3a41-4b53-b6d8-acc5a00d9c10" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.951948] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b in Status: SUCCESS [ 1090.952436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.952436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1090.952839] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1090.952839] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.953147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1090.953147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1090.953147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1090.953242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.953329] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.953362] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.964030] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.964422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1090.964422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1090.964422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1090.964540] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.964614] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.964718] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1090.964784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1090.964933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1090.965081] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.965179] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1090.965242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1090.965384] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1090.965471] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.965558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.965709] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.965810] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1090.965873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1090.966015] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1090.966089] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.966230] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.966320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1090.966380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1090.966519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1090.966659] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.966753] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1090.966815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1090.966951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1090.967033] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.967116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.967204] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.976948] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b: rpc.has_security_group_logging(os_id): False [ 1090.995126] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.995277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1090.995349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1090.995534] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1090.995626] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.995918] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.996503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1090.996503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1090.996503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1090.996642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.996817] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.996944] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1090.997069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1090.997290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1090.997373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.997621] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.997767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1090.997831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1090.998059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1090.998188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1090.998330] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b is going to be created. [ 1091.057158] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.057314] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1091.057362] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1091.057558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1091.057771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1091.069646] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b in Status: IN_PROGRESS for 2s [ 1093.083150] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b in Status: SUCCESS [ 1093.083150] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1093.248305] env[61817]: INFO networking_nsxv3.common.synchronization [None req-9509d48b-57d0-4161-a398-c2ea18fbb5c1 None None] Enqueued Resource ID: 2c318cad-84b8-49df-b357-dd165d423198 with Priority: HIGHEST for action port [ 1093.248305] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c318cad-84b8-49df-b357-dd165d423198 with Priority: HIGHEST for action port [ 1093.248305] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.248305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1093.248305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1093.248305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1093.248305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1093.248305] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c318cad-84b8-49df-b357-dd165d423198 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.248305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c318cad-84b8-49df-b357-dd165d423198" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1093.248305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c318cad-84b8-49df-b357-dd165d423198" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1093.248305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c318cad-84b8-49df-b357-dd165d423198" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1093.248305] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c318cad-84b8-49df-b357-dd165d423198',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.259000] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c318cad-84b8-49df-b357-dd165d423198 [ 1093.259000] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.259000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1093.259000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1093.259000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1093.259000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1093.259000] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c318cad-84b8-49df-b357-dd165d423198 already deleted. [ 1093.259000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c318cad-84b8-49df-b357-dd165d423198" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1095.624782] env[61817]: INFO networking_nsxv3.common.synchronization [None req-e40833cc-7253-48c1-8f9c-3922ea72bbbd None None] Enqueued Resource ID: a14447ea-9f89-4cd3-940b-49956c8ac7c8 with Priority: HIGHEST for action port [ 1095.625359] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14447ea-9f89-4cd3-940b-49956c8ac7c8 with Priority: HIGHEST for action port [ 1095.625682] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.625830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1095.625896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1095.626109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1095.626192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1095.626344] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-a14447ea-9f89-4cd3-940b-49956c8ac7c8 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.626434] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a14447ea-9f89-4cd3-940b-49956c8ac7c8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1095.626489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a14447ea-9f89-4cd3-940b-49956c8ac7c8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1095.626697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a14447ea-9f89-4cd3-940b-49956c8ac7c8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1095.626778] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a14447ea-9f89-4cd3-940b-49956c8ac7c8',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.681332] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a14447ea-9f89-4cd3-940b-49956c8ac7c8 [ 1095.681564] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.681728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1095.681856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1095.681978] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1095.682069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1095.682167] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a14447ea-9f89-4cd3-940b-49956c8ac7c8 already deleted. [ 1095.682251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a14447ea-9f89-4cd3-940b-49956c8ac7c8" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1095.829920] env[61817]: INFO networking_nsxv3.common.synchronization [None req-4bf4772e-655a-4c2a-8ce5-0e8390e9af7f None None] Enqueued Resource ID: 5f76aa83-c77b-4d1c-bf86-a9aae6c1c6b2 with Priority: HIGHEST for action port [ 1095.830155] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f76aa83-c77b-4d1c-bf86-a9aae6c1c6b2 with Priority: HIGHEST for action port [ 1095.830871] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.831012] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1095.831081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1095.831275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1095.831360] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1095.831524] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f76aa83-c77b-4d1c-bf86-a9aae6c1c6b2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.831621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f76aa83-c77b-4d1c-bf86-a9aae6c1c6b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1095.831684] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f76aa83-c77b-4d1c-bf86-a9aae6c1c6b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1095.831876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f76aa83-c77b-4d1c-bf86-a9aae6c1c6b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1095.831961] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f76aa83-c77b-4d1c-bf86-a9aae6c1c6b2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.847567] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f76aa83-c77b-4d1c-bf86-a9aae6c1c6b2 [ 1095.847780] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.847902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1095.847970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1095.848176] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1095.848262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1095.848349] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f76aa83-c77b-4d1c-bf86-a9aae6c1c6b2 already deleted. [ 1095.848424] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f76aa83-c77b-4d1c-bf86-a9aae6c1c6b2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1097.932406] env[61817]: INFO networking_nsxv3.common.synchronization [None req-c4fafc5d-3fae-4f94-b1ce-6b92ad9ca32e None None] Enqueued Resource ID: de35a7ea-da2e-49b3-8872-d2a372674602 with Priority: HIGHEST for action port [ 1097.932684] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de35a7ea-da2e-49b3-8872-d2a372674602 with Priority: HIGHEST for action port [ 1097.933217] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.933337] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1097.933401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1097.933605] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1097.933692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1097.933839] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-de35a7ea-da2e-49b3-8872-d2a372674602 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.933933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de35a7ea-da2e-49b3-8872-d2a372674602" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1097.933998] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de35a7ea-da2e-49b3-8872-d2a372674602" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1097.934190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de35a7ea-da2e-49b3-8872-d2a372674602" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1097.934322] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de35a7ea-da2e-49b3-8872-d2a372674602',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.960403] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de35a7ea-da2e-49b3-8872-d2a372674602 [ 1097.960618] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.960766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1097.960840] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1097.961039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1097.961129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1097.961221] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de35a7ea-da2e-49b3-8872-d2a372674602 already deleted. [ 1097.961343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de35a7ea-da2e-49b3-8872-d2a372674602" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1098.441780] env[61817]: INFO networking_nsxv3.common.synchronization [None req-c5c9a452-5dc3-416e-9b40-ad3eb0ae36ba tempest-TaggedAttachmentsTest-1373114596 tempest-TaggedAttachmentsTest-1373114596-project-member] Enqueued Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGHEST for action security_group_rules [ 1098.442303] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGHEST for action security_group_rules [ 1098.442620] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.442741] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1098.442810] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1098.443008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1098.443094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1098.443249] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.443348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1098.443409] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1098.443611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1098.443689] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.476804] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.477153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1098.477343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1098.477647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1098.477839] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1098.478020] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f129921-ca53-4911-9bcc-7d661d45384d already deleted. [ 1098.478195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1098.599554] env[61817]: INFO networking_nsxv3.common.synchronization [None req-2b0a3abe-aa75-4c5d-8597-480071c8e7c2 tempest-TaggedAttachmentsTest-1373114596 tempest-TaggedAttachmentsTest-1373114596-project-member] Enqueued Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGHEST for action security_group_rules [ 1098.599554] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGHEST for action security_group_rules [ 1098.599554] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.599554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1098.599554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1098.599554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1098.599554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1098.599554] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.599554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1098.599554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1098.599554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1098.599554] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.629044] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.629437] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1098.629668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1098.630002] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1098.630204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1098.630394] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f129921-ca53-4911-9bcc-7d661d45384d already deleted. [ 1098.630640] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1103.598923] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1103.599186] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1108.599792] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1108.600164] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1113.600644] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1113.601009] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1118.601823] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1118.602109] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1123.602623] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1123.602929] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1126.884770] env[61817]: INFO networking_nsxv3.common.synchronization [req-4e159b2a-b486-46f5-adb0-f6fd9c1569a6 req-deb750b3-146d-4f6d-9813-96f59dad5430 tempest-ServerDiskConfigTestJSON-1489146392 tempest-ServerDiskConfigTestJSON-1489146392-project-member] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1126.885382] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1126.885706] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.885834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1126.885906] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1126.886106] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1126.886324] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1126.886411] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.886508] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1126.886561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1126.886722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1126.886866] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.886955] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1126.887013] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1126.887147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1126.887226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1126.887312] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.908847] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.908991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1126.909039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1126.909323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1126.909323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1126.909493] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.909581] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1126.909640] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1126.909783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1126.909854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1126.909943] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1126.940817] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.940817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1126.940817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1126.940817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1126.940817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1126.950121] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1128.175273] env[61817]: INFO networking_nsxv3.common.synchronization [req-af3d0431-9866-493d-8f3d-8f42888a9169 req-dc33a806-9450-4a92-9de1-88f531e460a3 tempest-ServerRescueTestJSONUnderV235-65706538 tempest-ServerRescueTestJSONUnderV235-65706538-project-member] Enqueued Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGHEST for action security_group_members [ 1128.175816] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGHEST for action security_group_members [ 1128.176151] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.176274] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.176342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.176870] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.176973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.177133] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.177260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.177331] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.177542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.177685] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.177781] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.177843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.177987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.178068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.178157] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.195985] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.196206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.196206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.196399] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.196491] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.196681] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.196783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.196958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.197030] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.197078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.197144] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 already deleted. [ 1128.197233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.474078] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.474261] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.474383] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.474642] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.474790] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.475071] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-833 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.475226] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-833" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.475342] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-833" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.475617] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-833" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.475860] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.476015] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.476134] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.476342] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.476488] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.476625] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-833" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.476865] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.477012] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.477126] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.477323] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.477450] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.477681] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-7d704867-786c-4653-bb82-7432f6f5dc3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.477839] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-7d704867-786c-4653-bb82-7432f6f5dc3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.477953] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-7d704867-786c-4653-bb82-7432f6f5dc3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.478205] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-7d704867-786c-4653-bb82-7432f6f5dc3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.478337] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d704867-786c-4653-bb82-7432f6f5dc3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.493932] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.493932] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.493932] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.493932] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.493932] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.493932] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 7d704867-786c-4653-bb82-7432f6f5dc3d not found, creating... [ 1128.493932] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.494673] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.494884] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.495195] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.495360] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.495646] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.495800] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.495925] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.496185] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.496319] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.496460] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 7d704867-786c-4653-bb82-7432f6f5dc3d is going to be created. [ 1128.516768] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.517008] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.517143] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.517413] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.517643] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.517876] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-7d704867-786c-4653-bb82-7432f6f5dc3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.743096] env[61817]: INFO networking_nsxv3.common.synchronization [req-af3d0431-9866-493d-8f3d-8f42888a9169 req-a0594849-e397-458b-bb53-ef95326f414d service neutron] Enqueued Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGHEST for action security_group_rules [ 1128.743274] env[61817]: INFO networking_nsxv3.common.synchronization [req-af3d0431-9866-493d-8f3d-8f42888a9169 req-a0594849-e397-458b-bb53-ef95326f414d service neutron] Enqueued Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGHEST for action security_group_members [ 1128.743411] env[61817]: INFO networking_nsxv3.common.synchronization [req-af3d0431-9866-493d-8f3d-8f42888a9169 req-a0594849-e397-458b-bb53-ef95326f414d service neutron] Enqueued Resource ID: 7d704867-786c-4653-bb82-7432f6f5dc3d with Priority: HIGHEST for action port [ 1128.743633] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGHEST for action security_group_rules [ 1128.743779] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGHEST for action security_group_members [ 1128.743964] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d704867-786c-4653-bb82-7432f6f5dc3d with Priority: HIGHEST for action port [ 1128.744504] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.744584] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.744726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.744855] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.744936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.745082] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.745166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.745226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.745414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.745488] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.746447] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.746544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.746609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.746764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.746849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.746988] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.747075] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.747134] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.747272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.747402] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.747487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.747542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.747673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.747746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.747827] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.748848] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.749054] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.749054] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.749141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.749236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.749355] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d704867-786c-4653-bb82-7432f6f5dc3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.749442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d704867-786c-4653-bb82-7432f6f5dc3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.749499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d704867-786c-4653-bb82-7432f6f5dc3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.749635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d704867-786c-4653-bb82-7432f6f5dc3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.749701] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d704867-786c-4653-bb82-7432f6f5dc3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.761108] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.772895] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.773042] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.773109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.773305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.773388] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.773541] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.773631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.782955] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.783715] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d704867-786c-4653-bb82-7432f6f5dc3d with status ACTIVE [ 1128.783918] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.784052] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.784119] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.784310] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.784400] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.784567] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.784666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.784731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.784886] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.784964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.789403] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.789550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.789601] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.789749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.789836] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.789926] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 is going to be created. [ 1128.823581] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.823735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1128.823830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1128.824075] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1128.824243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1128.836264] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 in Status: UNINITIALIZED for 2s [ 1128.960499] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1128.960626] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 deletion is rescheduled due to dependency. [ 1128.960832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1129.155982] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.156198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1129.156318] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1129.156594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1129.156775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1129.156950] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d704867-786c-4653-bb82-7432f6f5dc3d is going to be updated. [ 1129.182054] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.182437] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1129.182437] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1129.182525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1129.182642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1129.182821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d704867-786c-4653-bb82-7432f6f5dc3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.847776] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 in Status: SUCCESS [ 1130.848162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.848497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.848760] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.848987] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.849127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1130.849198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.849387] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.849490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.849580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.849685] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.859330] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.859518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1130.859518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.859714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.859799] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.859954] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.860067] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1130.860131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.860282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.860418] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.860509] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1130.860569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.860721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.860801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.860884] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.861033] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.861123] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1130.861182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.861319] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.861390] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.861526] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.861616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1130.861676] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.861824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.861959] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.862047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1130.862106] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.862239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.862311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.862391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.862474] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.869677] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbf8f627-b3e9-41d3-bf72-822741bb5374: rpc.has_security_group_logging(os_id): False [ 1130.888143] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.888295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1130.888467] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.888544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.888661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.888945] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.891199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1130.891199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.891199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.891199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.891199] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.891199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1130.891199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.891199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.891199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.891199] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.891199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1130.891199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.891199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.891199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.891199] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 is going to be created. [ 1130.947327] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.947552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1130.947552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1130.947734] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1130.947914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1130.960653] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 in Status: IN_PROGRESS for 2s [ 1132.973459] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 in Status: SUCCESS [ 1132.973715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1133.745192] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1133.745329] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1138.746870] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1138.747235] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1143.748097] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1143.748348] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1148.749721] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1148.750047] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1153.751107] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1153.751107] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1158.751711] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1158.752034] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1163.752670] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1163.752966] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1168.754116] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1168.754384] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1173.755759] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1173.756017] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1176.895821] env[61817]: INFO networking_nsxv3.common.synchronization [req-73a72652-ded3-4f8e-bf78-f0b9d3b43d84 req-412c8bef-8363-483e-a99a-4068826ae8a5 tempest-ImagesNegativeTestJSON-326110035 tempest-ImagesNegativeTestJSON-326110035-project-member] Enqueued Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGHEST for action security_group_members [ 1176.896326] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGHEST for action security_group_members [ 1176.896641] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.896808] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1176.896852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1176.897025] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1176.897183] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1176.897346] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.897438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1176.897488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1176.897633] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1176.897901] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.897992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1176.898046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1176.898172] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1176.898254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1176.898343] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.907790] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.907946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1176.908014] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1176.908174] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1176.908264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1176.908438] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.908532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1176.908595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1176.908805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1176.908894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1176.908980] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 is going to be updated. [ 1177.057035] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.057196] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1177.057257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1177.057464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1177.057607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1177.066836] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 in Status: IN_PROGRESS for 2s [ 1178.066208] env[61817]: INFO networking_nsxv3.common.synchronization [req-040f08fb-5eec-460d-b38f-2501476783e1 req-1d428e6e-01dd-4ffb-9291-301159be3bce tempest-ServerDiskConfigTestJSON-1489146392 tempest-ServerDiskConfigTestJSON-1489146392-project-member] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1178.066967] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1178.067400] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.067560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.067631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.067846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.067950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.068137] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.068237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.068300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.068458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.068596] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.068707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.068769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.068911] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.068990] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.069088] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.077641] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.077775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.077845] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.078026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.078120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.078298] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.078392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.078466] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.078597] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.078675] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.078779] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1178.135027] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.135027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.135136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.135277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.135421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.145066] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1178.398857] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.399042] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.399180] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.399436] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.399576] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.399835] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.399993] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.400125] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.400348] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.400589] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.400767] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.400891] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.401106] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.401250] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.401398] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.401646] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.401836] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.402012] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.402255] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.402402] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.402644] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.402800] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.402921] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.403188] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.403329] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.418411] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.418634] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.418756] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.419107] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.419282] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.419443] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e not found, creating... [ 1178.419712] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.419870] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.419990] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.420242] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.420386] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.420671] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.420964] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.421099] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.421317] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.421458] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.421627] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e is going to be created. [ 1178.450019] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.450239] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.450368] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.450666] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.450963] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.451194] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.690976] env[61817]: INFO networking_nsxv3.common.synchronization [req-040f08fb-5eec-460d-b38f-2501476783e1 req-0f908bb5-f3cd-412b-8f82-7a41f205f43a service neutron] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_rules [ 1178.691215] env[61817]: INFO networking_nsxv3.common.synchronization [req-040f08fb-5eec-460d-b38f-2501476783e1 req-0f908bb5-f3cd-412b-8f82-7a41f205f43a service neutron] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1178.691297] env[61817]: INFO networking_nsxv3.common.synchronization [req-040f08fb-5eec-460d-b38f-2501476783e1 req-0f908bb5-f3cd-412b-8f82-7a41f205f43a service neutron] Enqueued Resource ID: a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e with Priority: HIGHEST for action port [ 1178.691516] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_rules [ 1178.691643] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1178.691755] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e with Priority: HIGHEST for action port [ 1178.692315] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.692442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.692510] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.692717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.692815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.692941] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.693035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.693094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.693252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.693329] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.694263] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.694263] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.694446] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.694446] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.694519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.694645] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.694721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.694907] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.695004] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.695066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.695206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.695278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.695412] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.695499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.695558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.695693] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.695765] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.715157] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.715364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.715364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.715558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.715652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.715796] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.715909] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.720485] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e with status ACTIVE [ 1178.720660] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.720801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.720864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.721030] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.721113] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1178.721276] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.721367] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1178.721425] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1178.721628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1178.721690] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1179.112400] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.112805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1179.112805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1179.112805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1179.112924] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1179.112962] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e is going to be updated. [ 1179.145167] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.145345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1179.145391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1179.145587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1179.145724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1179.145885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1179.959319] env[61817]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function GET Argumetns {'path': '/policy/api/v1/infra/realized-state/status', 'params': {'intent_path': '/infra/domains/default/groups/916dc4e3-1bc8-4ba5-b319-d9d0dee54564'}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1179.959477] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=61817) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}} [ 1180.162832] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1180.163225] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 deletion is rescheduled due to dependency. [ 1180.163274] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1180.163482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1180.163847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1180.163975] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.164137] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1180.164221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1180.164454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1180.164599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1180.164800] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.172621] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.181344] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.188252] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.188380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1180.188449] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1180.188666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1180.188765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1180.188864] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1180.216479] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.216632] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1180.216632] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1180.216832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1180.216980] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1180.225239] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1181.968718] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 in Status: SUCCESS [ 1181.969018] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 deletion is rescheduled due to dependency. [ 1181.969018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.234579] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1182.234815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.234985] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.235202] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.235398] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.235519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1182.235587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.235742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.235831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.235923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.236047] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.246663] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.246839] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1182.246892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.247079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.247160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.247321] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.247414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1182.247473] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.247616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.247751] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.247839] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1182.247897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.248044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.248122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.248201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.248425] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.248520] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1182.248580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.248885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.248991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.249209] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.249315] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1182.249378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.249540] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.249677] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.249767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1182.249825] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.250035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.250111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.250191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.250276] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.256718] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5233168b-5f93-4bb0-bac2-dd279d965d46: rpc.has_security_group_logging(os_id): False [ 1182.274259] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.274459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1182.274459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.274640] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.274727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.274913] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.275009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1182.275059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.275206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.275280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.275457] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.275545] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1182.275604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.275745] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.275816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.276030] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.276113] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1182.276173] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.276301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.276370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.276450] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1182.342654] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.342872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1182.342872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1182.343059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1182.343210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1182.356070] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1183.692376] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1183.692751] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1184.371208] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1184.371396] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1188.693113] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1188.693466] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1193.694412] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1193.694713] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1198.696131] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1198.696416] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1203.697606] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1203.697923] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1208.699141] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1208.699458] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1213.700675] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1213.700963] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1216.660886] env[61817]: INFO networking_nsxv3.common.synchronization [None req-e27c4526-db87-4572-b33a-ecd10866fae7 None None] Enqueued Resource ID: ac23207b-4862-4781-a045-6056700ee11d with Priority: HIGHEST for action port [ 1216.661172] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac23207b-4862-4781-a045-6056700ee11d with Priority: HIGHEST for action port [ 1216.661745] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.661918] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1216.661990] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1216.662201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1216.662285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1216.662433] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac23207b-4862-4781-a045-6056700ee11d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.662565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac23207b-4862-4781-a045-6056700ee11d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1216.662607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac23207b-4862-4781-a045-6056700ee11d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1216.662843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac23207b-4862-4781-a045-6056700ee11d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1216.662928] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac23207b-4862-4781-a045-6056700ee11d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.688312] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac23207b-4862-4781-a045-6056700ee11d [ 1216.688538] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.688663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1216.688716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1216.688952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1216.689055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1216.689135] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac23207b-4862-4781-a045-6056700ee11d already deleted. [ 1216.689211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac23207b-4862-4781-a045-6056700ee11d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1218.285442] env[61817]: INFO networking_nsxv3.common.synchronization [None req-884569ef-0127-4abf-9503-83c48853cdde None None] Enqueued Resource ID: 2897ac4b-c716-43e3-b2e6-8ae68adb22f0 with Priority: HIGHEST for action port [ 1218.285442] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2897ac4b-c716-43e3-b2e6-8ae68adb22f0 with Priority: HIGHEST for action port [ 1218.285442] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.285442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1218.285442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1218.285913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1218.285913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1218.285913] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-2897ac4b-c716-43e3-b2e6-8ae68adb22f0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.285913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2897ac4b-c716-43e3-b2e6-8ae68adb22f0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1218.285913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2897ac4b-c716-43e3-b2e6-8ae68adb22f0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1218.286112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2897ac4b-c716-43e3-b2e6-8ae68adb22f0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1218.286190] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2897ac4b-c716-43e3-b2e6-8ae68adb22f0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.295946] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2897ac4b-c716-43e3-b2e6-8ae68adb22f0 [ 1218.296357] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.296450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1218.296572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1218.296799] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1218.296961] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1218.297104] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2897ac4b-c716-43e3-b2e6-8ae68adb22f0 already deleted. [ 1218.297284] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2897ac4b-c716-43e3-b2e6-8ae68adb22f0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1223.285742] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1223.286079] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1226.907598] env[61817]: INFO networking_nsxv3.common.synchronization [req-c57f9007-b228-4bad-ba10-81852dc5e28f req-b615a11c-0fa9-42b7-87da-098d24d0c378 tempest-ServerGroupTestJSON-1144577638 tempest-ServerGroupTestJSON-1144577638-project-member] Enqueued Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGHEST for action security_group_members [ 1226.908146] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGHEST for action security_group_members [ 1226.908504] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.908626] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1226.908692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1226.908885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1226.908971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1226.909118] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.909211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1226.909272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1226.909448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1226.909587] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.909678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1226.909738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1226.909877] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1226.909974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1226.910066] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.919305] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.919446] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1226.919498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1226.919663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1226.919751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1226.919925] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.920047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1226.920117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1226.920264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1226.920342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1226.920426] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c is going to be updated. [ 1226.952544] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.952692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1226.952756] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1226.952972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1226.953150] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1226.964350] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c in Status: IN_PROGRESS for 2s [ 1228.454804] env[61817]: INFO networking_nsxv3.common.synchronization [req-ca313414-8c7b-4c9c-b00d-4ff389a82292 req-930b0e7d-ef79-4668-9645-da65dbd2a188 tempest-ServersTestBootFromVolume-333976937 tempest-ServersTestBootFromVolume-333976937-project-member] Enqueued Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGHEST for action security_group_members [ 1228.454804] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGHEST for action security_group_members [ 1228.454804] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.454804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.454804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.454804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.454804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.454804] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-627ba6ea-f974-4510-aa7b-1807964b9b40 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.454804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.454804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.455571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.455571] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.455571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.455571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.455571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.455571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.455571] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('627ba6ea-f974-4510-aa7b-1807964b9b40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.466187] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.466317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.466387] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.466826] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.466826] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.466968] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.466968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.467066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.467245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.467245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.467340] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 already deleted. [ 1228.467376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.795248] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.795440] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.795604] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.795908] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.796070] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.796325] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-132 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.796479] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-132" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.796596] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-132" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.796913] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-132" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.797168] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.797324] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.797441] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.797652] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.797790] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.797940] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-132" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.798248] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.799199] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.799353] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.799585] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.799725] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.799969] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-7fa12cc5-b014-48e3-aece-c2095df78b6c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.800141] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-7fa12cc5-b014-48e3-aece-c2095df78b6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.800293] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-7fa12cc5-b014-48e3-aece-c2095df78b6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.800695] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-7fa12cc5-b014-48e3-aece-c2095df78b6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.800695] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fa12cc5-b014-48e3-aece-c2095df78b6c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.815751] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.815966] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.816119] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.816458] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.816636] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.816840] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 7fa12cc5-b014-48e3-aece-c2095df78b6c not found, creating... [ 1228.817159] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.817354] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.817492] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.817741] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.817924] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.818294] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.818488] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.818633] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.818854] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.819023] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.819227] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 7fa12cc5-b014-48e3-aece-c2095df78b6c is going to be created. [ 1228.855298] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.855522] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1228.855650] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1228.855984] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1228.856203] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.856439] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-7fa12cc5-b014-48e3-aece-c2095df78b6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1228.981460] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c in Status: SUCCESS [ 1228.981658] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c deletion is rescheduled due to dependency. [ 1228.981910] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1229.087399] env[61817]: INFO networking_nsxv3.common.synchronization [req-ca313414-8c7b-4c9c-b00d-4ff389a82292 req-1872d191-55f9-48f1-b8a9-a74deccf19fd service neutron] Enqueued Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGHEST for action security_group_rules [ 1229.088295] env[61817]: INFO networking_nsxv3.common.synchronization [req-ca313414-8c7b-4c9c-b00d-4ff389a82292 req-1872d191-55f9-48f1-b8a9-a74deccf19fd service neutron] Enqueued Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGHEST for action security_group_members [ 1229.088295] env[61817]: INFO networking_nsxv3.common.synchronization [req-ca313414-8c7b-4c9c-b00d-4ff389a82292 req-1872d191-55f9-48f1-b8a9-a74deccf19fd service neutron] Enqueued Resource ID: 7fa12cc5-b014-48e3-aece-c2095df78b6c with Priority: HIGHEST for action port [ 1229.088295] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGHEST for action security_group_rules [ 1229.088295] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGHEST for action security_group_members [ 1229.088295] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa12cc5-b014-48e3-aece-c2095df78b6c with Priority: HIGHEST for action port [ 1229.090334] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.090484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.090531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.090722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.090850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1229.090992] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-627ba6ea-f974-4510-aa7b-1807964b9b40 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.091085] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.091151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.091306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.091397] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('627ba6ea-f974-4510-aa7b-1807964b9b40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.092258] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.092354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.092449] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.092562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.092642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1229.092765] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-627ba6ea-f974-4510-aa7b-1807964b9b40 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.092850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.092917] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.093036] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.093190] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.093278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.093327] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.093463] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.093537] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1229.093614] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('627ba6ea-f974-4510-aa7b-1807964b9b40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.094401] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.094502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.094586] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.094697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.094808] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1229.094890] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fa12cc5-b014-48e3-aece-c2095df78b6c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.094979] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fa12cc5-b014-48e3-aece-c2095df78b6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.095018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fa12cc5-b014-48e3-aece-c2095df78b6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.095355] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fa12cc5-b014-48e3-aece-c2095df78b6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.095355] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fa12cc5-b014-48e3-aece-c2095df78b6c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.111113] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('627ba6ea-f974-4510-aa7b-1807964b9b40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.120694] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.120911] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.120967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.121169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.121265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1229.121404] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-627ba6ea-f974-4510-aa7b-1807964b9b40 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.121893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.129028] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('627ba6ea-f974-4510-aa7b-1807964b9b40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.129674] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7fa12cc5-b014-48e3-aece-c2095df78b6c with status ACTIVE [ 1229.130430] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.130547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.130633] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.130811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.130910] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1229.131075] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.131196] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.131255] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.131371] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.131443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1229.137283] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.137418] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.137460] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.137643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.137723] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1229.137816] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 is going to be created. [ 1229.189881] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.190027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.190117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.190371] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.190567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1229.207026] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 in Status: UNINITIALIZED for 2s [ 1229.536282] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.536617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.536617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.536746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.536797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1229.536884] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7fa12cc5-b014-48e3-aece-c2095df78b6c is going to be updated. [ 1229.566571] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.566748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1229.566797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1229.566991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1229.567136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1229.567321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fa12cc5-b014-48e3-aece-c2095df78b6c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1231.218699] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 in Status: SUCCESS [ 1231.219194] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1231.219194] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1231.219327] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1231.219528] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.219649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1231.219717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1231.219873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1231.219949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1231.220055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1231.220179] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('627ba6ea-f974-4510-aa7b-1807964b9b40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.230200] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('627ba6ea-f974-4510-aa7b-1807964b9b40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.238343] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 627ba6ea-f974-4510-aa7b-1807964b9b40: rpc.has_security_group_logging(os_id): False [ 1231.259335] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.259584] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1231.259584] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1231.259706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1231.259794] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1231.260051] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.260162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1231.260217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1231.260367] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1231.260445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1231.260533] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 is going to be created. [ 1231.350182] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.350436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1231.350436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1231.350613] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1231.350849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1231.366254] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 in Status: IN_PROGRESS for 2s [ 1233.401174] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 in Status: SUCCESS [ 1233.401598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1233.754393] env[61817]: INFO networking_nsxv3.common.synchronization [None req-31830d95-d461-400f-b7db-8d38edfba58a tempest-AttachVolumeNegativeTest-329748670 tempest-AttachVolumeNegativeTest-329748670-project-member] Enqueued Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGHEST for action security_group_rules [ 1233.754927] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGHEST for action security_group_rules [ 1233.755247] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.755707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1233.755784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1233.755995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1233.756088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1233.756240] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.756333] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1233.756391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1233.756586] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1233.756779] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.786138] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.786300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1233.786368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1233.786563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1233.786658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1233.786753] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e583f7e5-364a-4a33-9784-9c313528bb3d already deleted. [ 1233.786838] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1233.853995] env[61817]: INFO networking_nsxv3.common.synchronization [None req-689997dc-0649-4611-a695-dd2cf249d4f7 tempest-AttachVolumeNegativeTest-329748670 tempest-AttachVolumeNegativeTest-329748670-project-member] Enqueued Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGHEST for action security_group_rules [ 1233.854349] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGHEST for action security_group_rules [ 1233.854667] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.854873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1233.854963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1233.855162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1233.855247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1233.855403] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.855502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1233.855561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1233.855705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1233.855783] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.887733] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.887878] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1233.888033] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1233.888182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1233.888279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1233.888374] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e583f7e5-364a-4a33-9784-9c313528bb3d already deleted. [ 1233.888457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1236.505548] env[61817]: INFO networking_nsxv3.common.synchronization [req-ca313414-8c7b-4c9c-b00d-4ff389a82292 req-5bb27935-244c-43ea-8264-19583e3b554c tempest-ServersTestBootFromVolume-333976937 tempest-ServersTestBootFromVolume-333976937-project-member] Enqueued Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGHEST for action security_group_members [ 1236.506118] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGHEST for action security_group_members [ 1236.506459] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.506713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1236.506858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1236.507111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1236.507257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1236.507449] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-627ba6ea-f974-4510-aa7b-1807964b9b40 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.507559] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1236.507624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1236.507797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1236.507947] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.508055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1236.508115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1236.508258] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1236.508341] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1236.508433] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('627ba6ea-f974-4510-aa7b-1807964b9b40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.524447] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.524615] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1236.524682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1236.524885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1236.524975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1236.525160] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.525252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1236.525310] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1236.525455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1236.525528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1236.525608] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 is going to be updated. [ 1236.557194] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.557343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1236.557414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1236.557633] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1236.557844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1236.568175] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 in Status: IN_PROGRESS for 2s [ 1237.000862] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1237.001018] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1237.920561] env[61817]: INFO networking_nsxv3.common.synchronization [req-9ae51c32-dc39-4b24-8311-1cefd5078884 req-363b8978-2636-421c-8c09-37a4881d383d tempest-DeleteServersTestJSON-1745478556 tempest-DeleteServersTestJSON-1745478556-project-member] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1237.921160] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1237.921476] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.921608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1237.921673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1237.921942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1237.922049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1237.922366] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.922366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1237.922366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1237.922558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1237.922681] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.922767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1237.922823] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1237.922955] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1237.923029] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1237.923115] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.940238] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.940238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1237.940343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1237.940526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1237.940691] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1237.940809] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.940950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1237.940950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1237.941084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1237.941162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1237.941247] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 already deleted. [ 1237.941324] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.221556] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.221770] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.221886] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.222155] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.222299] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.222553] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-455 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.222709] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.222827] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.223092] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.223336] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.223484] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.223602] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.223810] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.223951] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.224115] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.224416] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.224571] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.224730] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.224896] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.225033] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.225268] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-c1f25457-4838-4a36-ae2c-4a60c84796ef taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.225424] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-c1f25457-4838-4a36-ae2c-4a60c84796ef" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.225531] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-c1f25457-4838-4a36-ae2c-4a60c84796ef" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.225777] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-c1f25457-4838-4a36-ae2c-4a60c84796ef" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.225920] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1f25457-4838-4a36-ae2c-4a60c84796ef',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.248080] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.248304] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.248443] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.248761] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.248949] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.249110] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port c1f25457-4838-4a36-ae2c-4a60c84796ef not found, creating... [ 1238.249384] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.249546] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.249675] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.249919] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.250069] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.250363] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.250525] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.250655] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.250965] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.251105] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.251263] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: c1f25457-4838-4a36-ae2c-4a60c84796ef is going to be created. [ 1238.275769] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.275769] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.275769] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.275769] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.276130] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.276275] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-c1f25457-4838-4a36-ae2c-4a60c84796ef" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.539380] env[61817]: INFO networking_nsxv3.common.synchronization [req-9ae51c32-dc39-4b24-8311-1cefd5078884 req-84f651f1-ea8f-43b4-8b63-cf0ac1c71ae2 service neutron] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_rules [ 1238.539682] env[61817]: INFO networking_nsxv3.common.synchronization [req-9ae51c32-dc39-4b24-8311-1cefd5078884 req-84f651f1-ea8f-43b4-8b63-cf0ac1c71ae2 service neutron] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1238.539914] env[61817]: INFO networking_nsxv3.common.synchronization [req-9ae51c32-dc39-4b24-8311-1cefd5078884 req-84f651f1-ea8f-43b4-8b63-cf0ac1c71ae2 service neutron] Enqueued Resource ID: c1f25457-4838-4a36-ae2c-4a60c84796ef with Priority: HIGHEST for action port [ 1238.540594] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_rules [ 1238.540995] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1238.541071] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1f25457-4838-4a36-ae2c-4a60c84796ef with Priority: HIGHEST for action port [ 1238.541445] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.541621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.541701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.541987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.542111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.542301] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.542438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.542510] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.542775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.542866] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.548026] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.548026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.548026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.548026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.548026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.548026] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.548026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.548026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.548026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.548026] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.548026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.548026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.548026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.548026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.548026] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.548026] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.548920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.548920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.548920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.548920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.548920] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1f25457-4838-4a36-ae2c-4a60c84796ef taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.548920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1f25457-4838-4a36-ae2c-4a60c84796ef" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.548920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1f25457-4838-4a36-ae2c-4a60c84796ef" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.548920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1f25457-4838-4a36-ae2c-4a60c84796ef" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.548920] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1f25457-4838-4a36-ae2c-4a60c84796ef',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.564491] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.577348] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 in Status: SUCCESS [ 1238.577625] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 deletion is rescheduled due to dependency. [ 1238.577809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.578675] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.590480] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1f25457-4838-4a36-ae2c-4a60c84796ef with status ACTIVE [ 1238.591002] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.591216] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.591321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.591568] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.591706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.591997] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.592153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.592252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.592456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.592577] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.596452] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.596452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.596452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.596452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.596452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.596452] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be created. [ 1238.596837] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.596994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.597089] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.597304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.597428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.597846] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.597846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.645088] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.646746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.646827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.647059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.647219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.663651] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: UNINITIALIZED for 2s [ 1238.941175] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.941600] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.941600] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.941665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.941796] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.941835] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1f25457-4838-4a36-ae2c-4a60c84796ef is going to be updated. [ 1238.964959] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.965117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1238.965187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1238.965398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1238.965631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1238.965792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1f25457-4838-4a36-ae2c-4a60c84796ef" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.673001] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1240.673351] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.673396] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.673641] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.673844] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.674000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1240.674068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.674231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.674316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.674403] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.674496] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.684158] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.684292] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1240.684361] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.684532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.684615] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.684769] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.684868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1240.684929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.685083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.685278] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.685377] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1240.685436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.685576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.685666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.685725] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.685875] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.685966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1240.686025] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.686159] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.686229] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.686363] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.686450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1240.686509] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.686642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.686771] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.686860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1240.686919] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.687046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.687118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.687194] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.687278] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.693353] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0: rpc.has_security_group_logging(os_id): False [ 1240.710206] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.710372] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1240.710412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.710585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.710672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.710920] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.711065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1240.711065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.711234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.711276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.711475] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.711567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1240.711628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.711771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.711876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.712118] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.712180] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1240.712210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.712349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.712424] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.712510] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be created. [ 1240.771627] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.771627] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1240.771627] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1240.771627] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1240.771627] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1240.780559] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1241.830972] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.831312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1241.831312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1241.831394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1241.831481] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1241.831656] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.831757] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1241.831816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1241.832020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1241.832128] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.851511] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.908049] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.920134] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1241.920236] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1242.547886] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.548106] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.548184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.548395] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.563997] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1242.563997] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.563997] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1242.589451] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.589635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.589669] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.589862] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.595616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.596015] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1242.596112] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1242.596188] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1242.623859] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.623859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.623859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.623859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.624212] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.624347] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1242.666582] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.666783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.666783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.666994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.667220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.667389] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1242.706613] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.706829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.706903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.707109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.707277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.707449] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:15. [ 1242.707532] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'916dc4e3-1bc8-4ba5-b319-d9d0dee54564', 'bd22888a-f333-48c2-a433-ab2abba8ae54', '3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b', '1266a9f5-7050-4473-ad65-329e9724ea7d', 'a3ac00c4-e41d-4288-b6b9-01b5f4714e5a', '3ffcb57e-8678-415b-bd13-19b60dbd45bd', '6d193cbd-452d-400d-b88e-58fc27978848', 'bbf8f627-b3e9-41d3-bf72-822741bb5374', '62ddbcee-1db4-4515-8d5b-c25d44008cc0', '8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0', '627ba6ea-f974-4510-aa7b-1807964b9b40', '5a2644aa-f99a-4b14-9145-702ba5c8452b', '5233168b-5f93-4bb0-bac2-dd279d965d46', '905dd5f8-1bc0-4560-8294-1733c7eaf6f4', 'c5573ccf-d866-40ac-9bb4-1fa04e91ef9c'} {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1242.707600] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1242.727209] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.727350] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.727419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.727627] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.727714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.727821] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1242.727894] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1242.728089] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1242.772831] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.772831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.772831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.772831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.772831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.772831] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1242.772831] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1242.772831] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1242.772831] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1242.772831] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 15/15 resources of Type:Security Group Rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 1242.772831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGH for action security_group_rules [ 1242.774118] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGH for action security_group_rules [ 1242.774118] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1242.774118] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1242.774118] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.774118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.774118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.774118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.774118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.774118] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.774118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.774118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.774118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.774118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.776880] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.776880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.776880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.776880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.776880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.776880] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.776880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.776880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.776880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.776880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.776880] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.777358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.777358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.777358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.777358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.777358] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.777358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.777358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.777358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.777358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.777358] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.777358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.777358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.777647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.777647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.778193] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.778193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.778193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.778193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.778529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.778529] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.778600] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.780026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.780026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.780026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.780026] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.780026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.780026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.780026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.780026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.780026] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.780026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.780026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.780026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.780927] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.780927] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.780927] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.780927] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.780927] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.780927] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.781294] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.781294] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.781294] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.781402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.781556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.781637] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.781760] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.781892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.782313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.782313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.782444] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.782544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.782783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.782819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.782916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.783279] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.783279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.783367] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.783463] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.783553] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.783731] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.783817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.783874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.784015] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.784098] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.784274] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.784403] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.784538] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.784642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.784685] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.784831] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.784924] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.784986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.785128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.785207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.785383] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.785486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.785548] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.785731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.785776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.785961] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.786134] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.786134] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.786334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.786334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.786459] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.786542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.786597] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.786745] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.786790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.786947] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.787055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.787088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.787205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.787271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.787444] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.787528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.787595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.787724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.787791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.787961] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.788051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.788127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.788315] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.788343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.788528] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.788580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.788636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.788866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.788866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.788984] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1242.789041] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1242.789117] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1242.801367] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1242.801597] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.831868] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1030 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.832254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.832254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.832317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.832539] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.832714] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1242.873225] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1031 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.873378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1242.873438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1242.873819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1242.873819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1242.887172] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 1242.887343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.542961] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1243.542961] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=16], Jobs=0 [ 1243.542961] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGH for action security_group_rules [ 1243.543124] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGH for action security_group_rules [ 1243.543151] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGH for action security_group_rules [ 1243.543267] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGH for action security_group_rules [ 1243.543339] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGH for action security_group_rules [ 1243.543429] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 1243.543554] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 1243.543622] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 1243.543685] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGH for action security_group_rules [ 1243.543806] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 1243.543862] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGH for action security_group_rules [ 1243.543999] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 1243.544084] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGH for action security_group_rules [ 1243.544187] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGH for action security_group_rules [ 1243.544277] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGH for action security_group_rules [ 1243.544374] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGH for action security_group_rules [ 1243.544725] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.544855] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.544917] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.545121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.545209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.545346] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.545458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.545494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.545635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.545709] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.547074] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.547204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.547254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.547405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.547478] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.547616] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.547718] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.547754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.547892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.547972] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.548804] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.548906] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.548954] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.549095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.549172] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.549301] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.549397] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.549454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.549579] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.549650] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.550350] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.550472] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.550513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.550654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.550725] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.550886] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.550982] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.551026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.551164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.551228] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.551917] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.552165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.552284] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.552448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.552640] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.552794] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.552951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.553085] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.553262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.553346] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.555672] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.555817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.555968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.556182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.556368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.556582] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.556688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.556748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.556881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.556952] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.557845] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.557966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.558007] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.558151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.558221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.558354] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.558441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.558494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.558625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.558693] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.559417] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.559532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.559593] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.559745] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.559832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.559953] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-627ba6ea-f974-4510-aa7b-1807964b9b40 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.560061] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.560127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.560241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.560305] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('627ba6ea-f974-4510-aa7b-1807964b9b40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.561003] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.561148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.561177] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.561305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.561376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.561508] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.561640] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.561707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.561823] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.561909] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.562737] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.562829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.562895] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.563064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.563150] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.563420] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.563517] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.563581] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.563829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.563903] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.564616] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.564719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.564784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.564942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.565052] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.565199] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.565289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.565354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.565485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.565552] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.566235] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.566359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.566401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.566535] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.566606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.566738] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.566828] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.566884] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.567012] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.567076] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.567751] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.568545] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.568545] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.568671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.568671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.568843] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.568952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.568993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.569141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.569224] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.571459] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.571552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.571636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.572442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.572442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.572442] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.572442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.572442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.572442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.572442] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.573110] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.573190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.573228] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.573360] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.573432] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.573573] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.573664] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.573724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.573863] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.573948] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.610697] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.610956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.611067] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.611311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.611451] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.611664] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.611808] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.611903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.612113] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.612303] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.612438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.612531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.612709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.612854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.612975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.613110] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.615466] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.615466] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.615584] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.615805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.617520] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.617798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.617798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.617955] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.618069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.618250] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.618384] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.618479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.618670] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.618860] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.618996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.619091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.619268] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.619384] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.619500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.619618] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.641805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.641980] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 is going to be deleted. [ 1243.646670] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.646855] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.646963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.647211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.658492] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.658749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.658897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.659189] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.659357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.659571] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.659722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.659825] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.660076] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.660245] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.660399] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.660498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.660689] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.660843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.660973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.661164] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.661302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.661397] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.661578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.661705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.661898] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.662041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.662138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.662319] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.662599] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.662599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.662728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.662883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.663012] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.663211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.663211] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.664714] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.664963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.664963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.665154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.665274] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.665459] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.665612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.665712] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.665896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.666084] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.666224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.666322] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.666503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.666789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.666789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.666789] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.669926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.670089] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c is going to be deleted. [ 1243.674106] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.674307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.674417] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.674642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.677932] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.684345] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b: rpc.has_security_group_logging(os_id): False [ 1243.689294] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.689502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.689617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.689859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.689978] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.690273] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.690445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.690551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.690785] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.691023] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.691140] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.702911] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.703188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.703342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.703492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.704256] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.706260] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.712168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.712168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.712168] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 is going to be deleted. [ 1243.712168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.712168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.712168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.712168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.712168] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.712168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.712168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.712815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.712815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.712815] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.712815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.712815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.712815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.713133] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.713133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.713133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.713293] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.713293] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.713382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.713427] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.714262] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.714383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.714436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.714563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.714648] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.715282] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.715282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.715282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.715282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.715282] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.715282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.715644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.715644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.715644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.715644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.715644] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.717526] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.717648] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.717697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.717850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.717943] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.718089] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.718175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.718247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.718392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.718531] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.718622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.718683] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.718819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.718897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.718977] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.719056] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.720919] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.721027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.721096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.721354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.721354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.721728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.728305] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.728435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.728504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.728683] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.728768] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.728956] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.729172] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.729251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.729411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.729556] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.729714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.729714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.729842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.729923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.730007] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.730154] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.730247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.730307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.730447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.730515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.730651] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.730742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.730821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.730974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.731114] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.731438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.731505] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.731652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.731731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.731843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.731937] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.732887] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d193cbd-452d-400d-b88e-58fc27978848: rpc.has_security_group_logging(os_id): False [ 1243.739914] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.740175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.740207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.740736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.740857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.741044] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.741152] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.741217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.741543] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.741707] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.741825] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.741893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.742044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.742133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.742207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.742284] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.743177] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.743278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.743346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.743494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.743574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.743722] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.743824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.743904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.744068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.744215] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.744308] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.744368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.744507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.744586] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.744658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.744803] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.744888] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.745054] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.745215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.745284] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.745424] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.745514] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.745565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.745968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.746141] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.746240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.746302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.746733] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.746818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.746904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.746998] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.747893] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.748030] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.748100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.748250] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.748323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.748472] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.748559] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.748622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.748774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.748932] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.749029] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.749091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.749230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.749303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.749411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.749457] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.753494] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.753609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.753677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.753859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.755587] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.755690] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.755763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.755946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.756060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.756217] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.756330] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.756370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.756512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.756806] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.756902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.756967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.757112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.757194] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.757275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.757472] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.757516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.757565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.757700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.757767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.757909] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.757999] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.758059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.758196] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.758393] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.758542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.758612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.758763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.758857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.758940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.759030] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.759909] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.760126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.760126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.760276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.760367] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.760439] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.760527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.760586] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.760720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.760890] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.760987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.761049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.761189] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.761263] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.761344] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.761494] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.761583] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.761643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.761803] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.761887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.762041] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.762121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.762182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.762317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.762445] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.762526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.762582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.762710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.762907] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.762907] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.762988] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.763777] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.763882] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.763947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.764122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.764198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.764341] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.764435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.764496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.764637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.764774] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.764861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.764918] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.765048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.765117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.765191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.765338] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.765425] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.765485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.765619] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.765691] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.765828] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.765918] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.765977] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.766112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.766244] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.766330] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.766389] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.766523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.766595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.766672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.766904] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.767671] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbf8f627-b3e9-41d3-bf72-822741bb5374: rpc.has_security_group_logging(os_id): False [ 1243.770137] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.773055] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.773163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.773878] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.773967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.774415] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.774524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.774591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.774795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.774883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.775035] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.775134] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.775219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.775346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.775484] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.775577] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.775638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.775781] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.775863] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.775946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.776120] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.776214] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.776275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.776419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.776495] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.776635] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.776722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.776773] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.777072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.777229] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.777323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.777385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.777532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.777609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.777693] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.777784] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.784071] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62ddbcee-1db4-4515-8d5b-c25d44008cc0: rpc.has_security_group_logging(os_id): False [ 1243.796110] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0: rpc.has_security_group_logging(os_id): False [ 1243.797676] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd22888a-f333-48c2-a433-ab2abba8ae54: rpc.has_security_group_logging(os_id): False [ 1243.798598] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a2644aa-f99a-4b14-9145-702ba5c8452b: rpc.has_security_group_logging(os_id): False [ 1243.799504] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5233168b-5f93-4bb0-bac2-dd279d965d46: rpc.has_security_group_logging(os_id): False [ 1243.800917] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3ac00c4-e41d-4288-b6b9-01b5f4714e5a: rpc.has_security_group_logging(os_id): False [ 1243.815583] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.815746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.827371] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.827534] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.831369] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.831486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.835630] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.835929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.843007] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.843170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.844032] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.844141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.844897] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.844996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.845611] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.845708] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.846426] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.846523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.847247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.847468] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.847577] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.847644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.847847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.847936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.848136] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.848237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.848317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.848547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.848678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.848961] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.849096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.849196] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.849414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.849539] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.849678] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b is going to be updated. [ 1243.850735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.850915] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.852463] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.852541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.875768] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.875910] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 is going to be deleted. [ 1243.876902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.877117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.900618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.901012] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1266a9f5-7050-4473-ad65-329e9724ea7d is going to be deleted. [ 1243.902279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.902623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.938014] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.938139] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.949090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.949446] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.949659] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.949716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.949901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.949992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.950226] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.950341] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.950411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.950607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.950707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.950950] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.951027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1243.951117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.951223] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.951297] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1243.951392] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 is going to be updated. [ 1243.952704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1243.952868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1243.954468] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.954566] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.004428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.004745] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.004862] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.004932] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.005140] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.005224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.005321] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d193cbd-452d-400d-b88e-58fc27978848 is going to be updated. [ 1244.006489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.006675] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.054062] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.054309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.065149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.065467] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.065585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.065645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.065847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.065925] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.066152] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.066260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.066308] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.066457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.066530] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.066701] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.066786] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.066844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.066979] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.067051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.067140] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 is going to be updated. [ 1244.068346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.068507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.187200] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.187200] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.187408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.187408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.187582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.187694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.187892] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.188055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.188107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.188232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.188309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.188512] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.188586] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.188805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.188805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.188896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.188942] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1244.190058] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.190218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.207118] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.207253] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.208242] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.208380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.230028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.230308] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.230547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.230547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.230693] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.230819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.230972] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.231073] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.231137] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.231287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.231359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.231531] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.231616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.231666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.231799] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.231870] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.232165] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1244.233083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.233235] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.263153] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.263304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.271635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.271972] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.272131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.272172] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.272352] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.272432] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.272523] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a is going to be updated. [ 1244.273671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.273851] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.300705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.301155] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.301333] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.301392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.301562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.301651] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.301936] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.302044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.302112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.302265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.302339] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.302519] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.302597] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.302654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.307381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.307546] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.307664] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 1244.309353] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.309846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.362884] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.363061] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.375352] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.375539] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.390715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.391066] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.391198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.391267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.391473] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.391558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.391744] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.391922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.391922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.392042] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.392153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.392304] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.392384] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.392445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.392588] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.392665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.392759] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 is going to be updated. [ 1244.393898] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.394065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.394151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.394277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.394413] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.394558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.464951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.465091] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be deleted. [ 1244.466081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.466368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.466519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.467523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.467694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.467816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.469117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.469388] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.469441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.470698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.470919] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.471018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.471129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.471565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.471716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.471821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.471942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.472400] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.472554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.472687] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.473621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.473771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.473899] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.474816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.474967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.475091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.486089] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.486276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.486389] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.486516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.486657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.513215] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.513215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.513215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.513479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.513676] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.518355] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b in Status: SUCCESS [ 1244.518625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.519460] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 in Status: IN_PROGRESS for 2s [ 1244.520304] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a in Status: IN_PROGRESS for 2s [ 1244.520992] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d193cbd-452d-400d-b88e-58fc27978848 in Status: IN_PROGRESS for 2s [ 1244.522875] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 in Status: IN_PROGRESS for 2s [ 1244.525778] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1244.531144] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.531292] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.531344] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.531555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.531709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.533436] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: IN_PROGRESS for 2s [ 1244.534597] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1244.566822] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1244.611148] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1244.611640] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.611881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1244.611881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1244.612100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1244.612202] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1244.612325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1245.751701] env[61817]: INFO networking_nsxv3.common.synchronization [None req-313c8e0d-28b2-40f5-a690-6b7d6683a428 None None] Enqueued Resource ID: eb1e7f4d-d3fd-49cc-a953-b800865d1973 with Priority: HIGHEST for action port [ 1245.752012] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb1e7f4d-d3fd-49cc-a953-b800865d1973 with Priority: HIGHEST for action port [ 1245.752603] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.752722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1245.752787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1245.752981] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1245.753058] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1245.753204] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb1e7f4d-d3fd-49cc-a953-b800865d1973 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.753295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb1e7f4d-d3fd-49cc-a953-b800865d1973" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1245.753352] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb1e7f4d-d3fd-49cc-a953-b800865d1973" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1245.753543] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb1e7f4d-d3fd-49cc-a953-b800865d1973" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1245.753621] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb1e7f4d-d3fd-49cc-a953-b800865d1973',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.763504] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb1e7f4d-d3fd-49cc-a953-b800865d1973 [ 1245.763721] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.763840] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1245.763904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1245.764118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1245.764202] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1245.764291] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb1e7f4d-d3fd-49cc-a953-b800865d1973 already deleted. [ 1245.764367] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb1e7f4d-d3fd-49cc-a953-b800865d1973" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1246.538601] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 in Status: SUCCESS [ 1246.538869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1246.539630] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a in Status: SUCCESS [ 1246.539810] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1246.540517] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d193cbd-452d-400d-b88e-58fc27978848 in Status: SUCCESS [ 1246.540689] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1246.541363] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 in Status: SUCCESS [ 1246.541530] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1246.542157] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1246.542330] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1246.543667] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1246.543830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1246.544488] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: SUCCESS [ 1246.544659] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1246.579675] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1246.579899] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1247.611575] env[61817]: INFO networking_nsxv3.common.synchronization [None req-2b62ad9b-c87b-4c4b-b224-e360cee45e34 None None] Enqueued Resource ID: 5b01c795-370e-4b43-92fc-72eb1e247f6e with Priority: HIGHEST for action port [ 1247.611869] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b01c795-370e-4b43-92fc-72eb1e247f6e with Priority: HIGHEST for action port [ 1247.612451] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.612579] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1247.612646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1247.612849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1247.612937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1247.613112] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b01c795-370e-4b43-92fc-72eb1e247f6e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.613198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b01c795-370e-4b43-92fc-72eb1e247f6e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1247.613245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b01c795-370e-4b43-92fc-72eb1e247f6e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1247.613447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b01c795-370e-4b43-92fc-72eb1e247f6e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1247.613526] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b01c795-370e-4b43-92fc-72eb1e247f6e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.637144] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b01c795-370e-4b43-92fc-72eb1e247f6e [ 1247.637360] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.637487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1247.637555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1247.637757] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1247.637848] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1247.637941] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b01c795-370e-4b43-92fc-72eb1e247f6e already deleted. [ 1247.638022] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b01c795-370e-4b43-92fc-72eb1e247f6e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1252.613313] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1252.613623] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1257.614573] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.614929] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1258.130686] env[61817]: INFO networking_nsxv3.common.synchronization [None req-84e4ec8a-61f7-41ca-a8f8-6eec42205160 None None] Enqueued Resource ID: 7fdcd813-2d91-4c8a-84c2-aafffdb6fa91 with Priority: HIGHEST for action port [ 1258.131008] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdcd813-2d91-4c8a-84c2-aafffdb6fa91 with Priority: HIGHEST for action port [ 1258.131569] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.131691] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.131839] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.132139] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.132235] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1258.132402] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fdcd813-2d91-4c8a-84c2-aafffdb6fa91 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.132501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fdcd813-2d91-4c8a-84c2-aafffdb6fa91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.132564] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fdcd813-2d91-4c8a-84c2-aafffdb6fa91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.132775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fdcd813-2d91-4c8a-84c2-aafffdb6fa91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.132892] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fdcd813-2d91-4c8a-84c2-aafffdb6fa91',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.167732] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fdcd813-2d91-4c8a-84c2-aafffdb6fa91 [ 1258.168042] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.172719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.172719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.172719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.172719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1258.172719] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fdcd813-2d91-4c8a-84c2-aafffdb6fa91 already deleted. [ 1258.172719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fdcd813-2d91-4c8a-84c2-aafffdb6fa91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1258.813529] env[61817]: INFO networking_nsxv3.common.synchronization [None req-1b23c72e-a85b-4803-993d-08efa759f5ad tempest-ServersTestManualDisk-772162140 tempest-ServersTestManualDisk-772162140-project-member] Enqueued Resource ID: 29720325-c9a6-4f03-a771-bba2912318a5 with Priority: HIGHEST for action security_group_rules [ 1258.814945] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29720325-c9a6-4f03-a771-bba2912318a5 with Priority: HIGHEST for action security_group_rules [ 1258.814945] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.814945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.814945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.815136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.815136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1258.815297] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29720325-c9a6-4f03-a771-bba2912318a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.815410] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29720325-c9a6-4f03-a771-bba2912318a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.815494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29720325-c9a6-4f03-a771-bba2912318a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.815911] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29720325-c9a6-4f03-a771-bba2912318a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.816007] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29720325-c9a6-4f03-a771-bba2912318a5',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.848338] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.848490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.848576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.848798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.848873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1258.848966] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29720325-c9a6-4f03-a771-bba2912318a5 already deleted. [ 1258.849047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29720325-c9a6-4f03-a771-bba2912318a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1258.952642] env[61817]: INFO networking_nsxv3.common.synchronization [None req-cc88ebe0-080e-437d-99e6-ba8fcbd0cad0 tempest-ServersTestManualDisk-772162140 tempest-ServersTestManualDisk-772162140-project-member] Enqueued Resource ID: 29720325-c9a6-4f03-a771-bba2912318a5 with Priority: HIGHEST for action security_group_rules [ 1258.953149] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29720325-c9a6-4f03-a771-bba2912318a5 with Priority: HIGHEST for action security_group_rules [ 1258.953486] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.953602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.953665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.953872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.953952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1258.954096] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29720325-c9a6-4f03-a771-bba2912318a5 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.954186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29720325-c9a6-4f03-a771-bba2912318a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.954243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29720325-c9a6-4f03-a771-bba2912318a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.954385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29720325-c9a6-4f03-a771-bba2912318a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.954460] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29720325-c9a6-4f03-a771-bba2912318a5',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.984286] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.984428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1258.984497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1258.984738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1258.984770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1258.985108] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29720325-c9a6-4f03-a771-bba2912318a5 already deleted. [ 1258.985108] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29720325-c9a6-4f03-a771-bba2912318a5" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.656071] env[61817]: INFO networking_nsxv3.common.synchronization [None req-a2387dab-e034-4cdb-9656-428f5895711e tempest-AttachVolumeTestJSON-2111320188 tempest-AttachVolumeTestJSON-2111320188-project-member] Enqueued Resource ID: 402adf05-0b62-450a-bbf5-a17cf065f297 with Priority: HIGHEST for action security_group_rules [ 1259.656071] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402adf05-0b62-450a-bbf5-a17cf065f297 with Priority: HIGHEST for action security_group_rules [ 1259.656071] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.656071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.656071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.656071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.656071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.656071] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-402adf05-0b62-450a-bbf5-a17cf065f297 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.656071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-402adf05-0b62-450a-bbf5-a17cf065f297" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.656071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-402adf05-0b62-450a-bbf5-a17cf065f297" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.656071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-402adf05-0b62-450a-bbf5-a17cf065f297" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.656071] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('402adf05-0b62-450a-bbf5-a17cf065f297',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.688663] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.688663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.688663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.688663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.688663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.688663] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 402adf05-0b62-450a-bbf5-a17cf065f297 already deleted. [ 1259.688663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-402adf05-0b62-450a-bbf5-a17cf065f297" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.792562] env[61817]: INFO networking_nsxv3.common.synchronization [None req-271b160b-eace-4da9-9b57-74db6a10dd1d tempest-AttachVolumeTestJSON-2111320188 tempest-AttachVolumeTestJSON-2111320188-project-member] Enqueued Resource ID: 402adf05-0b62-450a-bbf5-a17cf065f297 with Priority: HIGHEST for action security_group_rules [ 1259.793236] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 402adf05-0b62-450a-bbf5-a17cf065f297 with Priority: HIGHEST for action security_group_rules [ 1259.793677] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.793955] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.794567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.794902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.795124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.795387] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-402adf05-0b62-450a-bbf5-a17cf065f297 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.795615] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-402adf05-0b62-450a-bbf5-a17cf065f297" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.795779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-402adf05-0b62-450a-bbf5-a17cf065f297" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.796051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-402adf05-0b62-450a-bbf5-a17cf065f297" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.796237] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('402adf05-0b62-450a-bbf5-a17cf065f297',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.835691] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.836317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1259.836502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1259.836797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1259.836998] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1259.837196] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 402adf05-0b62-450a-bbf5-a17cf065f297 already deleted. [ 1259.837540] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-402adf05-0b62-450a-bbf5-a17cf065f297" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1260.149550] env[61817]: INFO networking_nsxv3.common.synchronization [None req-ee87221b-3b25-4a90-af61-f747f8f2606d None None] Enqueued Resource ID: db606f6e-b985-469e-8388-0eb220941383 with Priority: HIGHEST for action port [ 1260.149829] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db606f6e-b985-469e-8388-0eb220941383 with Priority: HIGHEST for action port [ 1260.150423] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.150550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1260.150617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1260.150885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1260.150984] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1260.151135] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-db606f6e-b985-469e-8388-0eb220941383 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.151230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db606f6e-b985-469e-8388-0eb220941383" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1260.151286] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db606f6e-b985-469e-8388-0eb220941383" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1260.151488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db606f6e-b985-469e-8388-0eb220941383" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1260.151568] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db606f6e-b985-469e-8388-0eb220941383',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.161026] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db606f6e-b985-469e-8388-0eb220941383 [ 1260.161264] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.161418] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1260.161509] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1260.161738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1260.161857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1260.162100] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db606f6e-b985-469e-8388-0eb220941383 already deleted. [ 1260.162346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db606f6e-b985-469e-8388-0eb220941383" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1265.150615] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1265.151027] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1270.152312] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.152594] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1275.153954] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.154379] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1277.545668] env[61817]: INFO networking_nsxv3.common.synchronization [req-fc0b63fe-e867-4f45-989b-37a738a62569 req-84b6dcab-d112-45e3-92eb-bf0f11f90567 tempest-InstanceActionsTestJSON-555491356 tempest-InstanceActionsTestJSON-555491356-project-member] Enqueued Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGHEST for action security_group_members [ 1277.546199] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGHEST for action security_group_members [ 1277.546562] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.546658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1277.546724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1277.546931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1277.547057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1277.547164] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.547258] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1277.547312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1277.547456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1277.547587] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.547673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1277.547736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1277.547861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1277.547934] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1277.548419] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.559252] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.559381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1277.559461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1277.559618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1277.559710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1277.559885] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.559980] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1277.560057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1277.560208] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1277.560285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1277.560370] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 is going to be updated. [ 1277.594117] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.594301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1277.594411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1277.594788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1277.595018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1277.604754] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 in Status: IN_PROGRESS for 2s [ 1279.078337] env[61817]: INFO networking_nsxv3.common.synchronization [req-03fb4196-531f-46be-b2ef-f094465577c5 req-12a81dae-17ae-47cf-9b8c-a98f2c415ace tempest-ServersTestJSON-1722207346 tempest-ServersTestJSON-1722207346-project-member] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1279.078940] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1279.079278] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.079402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.079474] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.079665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.079808] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.080029] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.080130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.080168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.080319] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.080461] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.080537] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.080595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.080733] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.080858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.080949] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.094443] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.094622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.094622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.095240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.095240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.095420] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.095522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.095579] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.095728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.095806] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.095894] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be deleted. [ 1279.132344] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.132515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.132633] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.132788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.132887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.132982] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.458029] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.458229] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.458356] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.458619] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.458767] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.459026] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-463 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.459177] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.459291] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.459511] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.459746] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.459928] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.460069] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.460279] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.460417] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.460561] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.460826] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.460987] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.461105] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.461310] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.461441] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.461673] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-e29cbb11-cf7f-41b5-989c-ea7b0d3707e4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.461847] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-e29cbb11-cf7f-41b5-989c-ea7b0d3707e4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.461970] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-e29cbb11-cf7f-41b5-989c-ea7b0d3707e4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.462233] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-e29cbb11-cf7f-41b5-989c-ea7b0d3707e4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.462367] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e29cbb11-cf7f-41b5-989c-ea7b0d3707e4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.482303] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.482516] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.482644] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.482944] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.483159] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.483337] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port e29cbb11-cf7f-41b5-989c-ea7b0d3707e4 not found, creating... [ 1279.483595] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.483751] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.483872] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.484122] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.484267] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.484549] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.484707] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.484829] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.485042] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.485179] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.485323] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: e29cbb11-cf7f-41b5-989c-ea7b0d3707e4 is going to be created. [ 1279.507507] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.507721] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.507843] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.508150] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.508598] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.508598] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-e29cbb11-cf7f-41b5-989c-ea7b0d3707e4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.622700] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 in Status: SUCCESS [ 1279.622904] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 deletion is rescheduled due to dependency. [ 1279.622967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.739082] env[61817]: INFO networking_nsxv3.common.synchronization [req-03fb4196-531f-46be-b2ef-f094465577c5 req-79d67e2b-8de6-4956-b52d-b83355ff368a service neutron] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_rules [ 1279.739257] env[61817]: INFO networking_nsxv3.common.synchronization [req-03fb4196-531f-46be-b2ef-f094465577c5 req-79d67e2b-8de6-4956-b52d-b83355ff368a service neutron] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1279.739404] env[61817]: INFO networking_nsxv3.common.synchronization [req-03fb4196-531f-46be-b2ef-f094465577c5 req-79d67e2b-8de6-4956-b52d-b83355ff368a service neutron] Enqueued Resource ID: e29cbb11-cf7f-41b5-989c-ea7b0d3707e4 with Priority: HIGHEST for action port [ 1279.739628] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_rules [ 1279.739753] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1279.739849] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e29cbb11-cf7f-41b5-989c-ea7b0d3707e4 with Priority: HIGHEST for action port [ 1279.740416] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.740562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.740641] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.740826] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.740968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.741072] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.741164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.741338] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.741385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.741487] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.742449] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.742565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.742636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.742790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.742869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.743002] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.743093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.743155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.743294] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.743430] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.743517] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.743583] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.743709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.743788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.743877] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.744627] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.744735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.744801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.744979] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.745075] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.745218] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-e29cbb11-cf7f-41b5-989c-ea7b0d3707e4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.745305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e29cbb11-cf7f-41b5-989c-ea7b0d3707e4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.745373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e29cbb11-cf7f-41b5-989c-ea7b0d3707e4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.745520] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e29cbb11-cf7f-41b5-989c-ea7b0d3707e4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.745582] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e29cbb11-cf7f-41b5-989c-ea7b0d3707e4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.758832] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.767679] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.767822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.767892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.768106] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.768193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.768351] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.768438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.773213] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.782012] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e29cbb11-cf7f-41b5-989c-ea7b0d3707e4 with status ACTIVE [ 1279.782235] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.782368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.782436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.782637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.782766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.782895] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.783007] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.783146] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.783259] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.783326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.785753] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.785861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.785944] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.786088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.786171] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.786258] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be created. [ 1279.823300] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.823459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1279.823558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1279.823733] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1279.823899] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1279.833632] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: UNINITIALIZED for 2s [ 1280.211912] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.212357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1280.212357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1280.212435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1280.212560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1280.212657] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e29cbb11-cf7f-41b5-989c-ea7b0d3707e4 is going to be updated. [ 1280.234993] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.235164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1280.235164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1280.235377] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1280.235535] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1280.235697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e29cbb11-cf7f-41b5-989c-ea7b0d3707e4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.844113] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 1281.844493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.844493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.844786] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.845055] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.845162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1281.845206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.845360] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.845446] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.845562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.845683] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.854768] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.854910] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1281.854954] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.855111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.855192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.855348] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.855456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1281.855500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.855643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.855780] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.855865] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1281.855923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.856084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.856191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.856275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.856480] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.856604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1281.856678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.856861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.856949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.857095] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.857187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1281.857310] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.857455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.857591] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.857683] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1281.857750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.857935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.858016] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.858103] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.858184] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.865259] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ffcb57e-8678-415b-bd13-19b60dbd45bd: rpc.has_security_group_logging(os_id): False [ 1281.882561] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.882689] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1281.882769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.882989] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.883148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.883381] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.883485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1281.883546] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.883702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.883779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.883970] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.884073] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1281.884132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.884276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.885295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.885295] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.885295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1281.885295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.885295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.885295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.885295] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be created. [ 1281.943678] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.943819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1281.943890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1281.944141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1281.944351] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1281.958291] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 1283.973422] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 1283.973735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1284.741289] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1284.741289] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1289.742409] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.742706] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1292.974656] env[61817]: INFO networking_nsxv3.common.synchronization [req-9ae51c32-dc39-4b24-8311-1cefd5078884 req-df884c39-e3d2-44b9-8f2f-749eb8fe0c2f tempest-DeleteServersTestJSON-1745478556 tempest-DeleteServersTestJSON-1745478556-project-member] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1292.975160] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1292.975465] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.975595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1292.975661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1292.975842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1292.975930] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1292.976114] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.976217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1292.976280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1292.976563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1292.976649] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.976756] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1292.976849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1292.976994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1292.977071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1292.977159] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.992697] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.992854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1292.992891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1292.993495] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1292.993495] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1292.993495] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.993495] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1292.993495] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1292.993884] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1292.993884] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1292.993884] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 1293.027513] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.027696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1293.027749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1293.027945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1293.028126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1293.037860] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1293.993170] env[61817]: INFO networking_nsxv3.common.synchronization [req-a6d3a571-b087-40f8-ad62-d645b94bd18c req-4643016d-0789-4dff-acb8-2a9013a5dcc2 tempest-TaggedAttachmentsTest-1373114596 tempest-TaggedAttachmentsTest-1373114596-project-member] Enqueued Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGHEST for action security_group_members [ 1293.993550] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGHEST for action security_group_members [ 1293.994330] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.994462] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1293.994529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1293.994724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1293.994809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1293.994976] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.995072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1293.995137] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1293.995331] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1293.995467] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.995557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1293.995616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1293.995752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1293.995829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1293.995915] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.006186] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.006300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.006370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.006541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.006623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.006792] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.006877] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.006933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.007070] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.007141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.007219] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f129921-ca53-4911-9bcc-7d661d45384d already deleted. [ 1294.007290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.309566] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.309776] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.309909] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.310176] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.310324] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.310581] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-544 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.310735] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-544" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.310887] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-544" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.311169] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-544" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.311430] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.311591] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.311748] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.311959] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.312119] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.312272] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-544" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.312522] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.312681] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.312800] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.313041] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.313184] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.313426] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-4aaea5b2-3b79-47a7-98c6-2653d175f630 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.313584] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-4aaea5b2-3b79-47a7-98c6-2653d175f630" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.313704] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-4aaea5b2-3b79-47a7-98c6-2653d175f630" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.313952] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-4aaea5b2-3b79-47a7-98c6-2653d175f630" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.314101] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aaea5b2-3b79-47a7-98c6-2653d175f630',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.332076] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.332385] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.332564] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.332909] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.333075] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.333268] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 4aaea5b2-3b79-47a7-98c6-2653d175f630 not found, creating... [ 1294.333555] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.333740] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.333891] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.334130] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.334271] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.334590] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.334756] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.334915] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.335546] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.335892] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.336087] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 4aaea5b2-3b79-47a7-98c6-2653d175f630 is going to be created. [ 1294.363435] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.363707] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.363867] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.364248] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.364584] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.364789] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-4aaea5b2-3b79-47a7-98c6-2653d175f630" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.586724] env[61817]: INFO networking_nsxv3.common.synchronization [req-a6d3a571-b087-40f8-ad62-d645b94bd18c req-3ced4d91-ff58-4963-a72b-fdb8fb5a6b94 service neutron] Enqueued Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGHEST for action security_group_rules [ 1294.586907] env[61817]: INFO networking_nsxv3.common.synchronization [req-a6d3a571-b087-40f8-ad62-d645b94bd18c req-3ced4d91-ff58-4963-a72b-fdb8fb5a6b94 service neutron] Enqueued Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGHEST for action security_group_members [ 1294.587047] env[61817]: INFO networking_nsxv3.common.synchronization [req-a6d3a571-b087-40f8-ad62-d645b94bd18c req-3ced4d91-ff58-4963-a72b-fdb8fb5a6b94 service neutron] Enqueued Resource ID: 4aaea5b2-3b79-47a7-98c6-2653d175f630 with Priority: HIGHEST for action port [ 1294.587268] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGHEST for action security_group_rules [ 1294.587388] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGHEST for action security_group_members [ 1294.587481] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aaea5b2-3b79-47a7-98c6-2653d175f630 with Priority: HIGHEST for action port [ 1294.588061] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.588192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.588257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.588452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.588532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.588677] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.588765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.588822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.588958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.589029] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.589815] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.589916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.589975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.590121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.590192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.590329] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.592304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.592304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.592304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.592659] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.592773] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.592837] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.592987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.593066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.593152] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.593884] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.593991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.594055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.594200] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.594270] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.594404] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-4aaea5b2-3b79-47a7-98c6-2653d175f630 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.594484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4aaea5b2-3b79-47a7-98c6-2653d175f630" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.594545] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4aaea5b2-3b79-47a7-98c6-2653d175f630" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.594677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4aaea5b2-3b79-47a7-98c6-2653d175f630" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.594745] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aaea5b2-3b79-47a7-98c6-2653d175f630',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.622973] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.623320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.623486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.623791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.623976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.624260] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.624790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.626836] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4aaea5b2-3b79-47a7-98c6-2653d175f630 with status ACTIVE [ 1294.627249] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.627486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.627648] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.627975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.628226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.628574] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.628819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.629023] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.629283] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.629466] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.630914] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.641262] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.649732] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.650084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.650358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.651941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.651941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.651941] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f129921-ca53-4911-9bcc-7d661d45384d is going to be created. [ 1294.681968] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.682117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1294.682184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1294.682400] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1294.682563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1294.692449] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f129921-ca53-4911-9bcc-7d661d45384d in Status: UNINITIALIZED for 2s [ 1295.010939] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.011429] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1295.011429] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1295.011429] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1295.011605] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1295.011605] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4aaea5b2-3b79-47a7-98c6-2653d175f630 is going to be updated. [ 1295.037026] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.037345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1295.037345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1295.037572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1295.037646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1295.037830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4aaea5b2-3b79-47a7-98c6-2653d175f630" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1295.048946] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1295.049180] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 deletion is rescheduled due to dependency. [ 1295.049279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1296.702087] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f129921-ca53-4911-9bcc-7d661d45384d in Status: SUCCESS [ 1296.702419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1296.702419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1296.702557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1296.702740] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.702857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1296.702925] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1296.703079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1296.703163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1296.703248] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1296.703336] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.712837] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.718804] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f129921-ca53-4911-9bcc-7d661d45384d: rpc.has_security_group_logging(os_id): False [ 1296.736106] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.736257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1296.736328] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1296.736535] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1296.736631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1296.736867] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.736967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1296.737053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1296.737246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1296.737329] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1296.737418] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f129921-ca53-4911-9bcc-7d661d45384d is going to be created. [ 1296.799792] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.799939] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1296.800019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1296.800324] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1296.800510] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1296.811426] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f129921-ca53-4911-9bcc-7d661d45384d in Status: IN_PROGRESS for 2s [ 1298.824821] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f129921-ca53-4911-9bcc-7d661d45384d in Status: SUCCESS [ 1298.825069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1299.589209] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1299.589378] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1304.590038] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1304.590038] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1309.591264] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1309.591533] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1314.592434] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.592749] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1319.593533] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1319.593949] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1324.594883] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1324.595197] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1326.624597] env[61817]: INFO networking_nsxv3.common.synchronization [req-1a0eceb3-0800-4c89-8366-abc4ca18cc0e req-c09f41c8-d66d-4cb7-82c5-711eab2c3e30 tempest-AttachVolumeNegativeTest-329748670 tempest-AttachVolumeNegativeTest-329748670-project-member] Enqueued Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGHEST for action security_group_members [ 1326.625157] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGHEST for action security_group_members [ 1326.625474] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.625594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1326.625660] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1326.625849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1326.625929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1326.626078] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.626172] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1326.626232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1326.626383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1326.626513] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.626617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1326.626660] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1326.626791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1326.626872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1326.626962] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.637527] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.637652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1326.637737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1326.637891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1326.637974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1326.638152] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.638257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1326.638300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1326.638443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1326.638514] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1326.638595] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d193cbd-452d-400d-b88e-58fc27978848 is going to be updated. [ 1326.669017] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.669162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1326.669232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1326.669493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1326.669667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1326.681181] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d193cbd-452d-400d-b88e-58fc27978848 in Status: IN_PROGRESS for 2s [ 1328.692254] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d193cbd-452d-400d-b88e-58fc27978848 in Status: SUCCESS [ 1328.692531] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d193cbd-452d-400d-b88e-58fc27978848 deletion is rescheduled due to dependency. [ 1328.692569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1328.925235] env[61817]: INFO networking_nsxv3.common.synchronization [req-e2dacbe9-402b-42c1-803f-4545a5563227 req-e7920399-d020-4492-8475-b419f0ca09d6 tempest-ServerTagsTestJSON-3206530 tempest-ServerTagsTestJSON-3206530-project-member] Enqueued Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGHEST for action security_group_members [ 1328.925693] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGHEST for action security_group_members [ 1328.926039] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.926239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1328.926350] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1328.926598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1328.926713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1328.926902] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.927014] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1328.927078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1328.927293] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1328.927439] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.927534] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1328.927595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1328.927736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1328.927819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1328.927923] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.946163] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.946305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1328.946374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1328.946572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1328.946658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1328.946883] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.947100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1328.947100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1328.947162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1328.947192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1328.947270] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1620446-f273-4658-baad-13a497dabc74 already deleted. [ 1328.947346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.408912] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.409121] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.409253] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.409527] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.409679] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.409936] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-769 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.410095] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-769" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.410216] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-769" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.410487] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-769" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.410736] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.410924] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.411048] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.411259] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.411400] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.411551] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-769" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.411810] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.411982] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.412118] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.412334] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.412463] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.412699] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-39122a3d-a49b-4abc-abfc-aa7bec83e93c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.412855] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-39122a3d-a49b-4abc-abfc-aa7bec83e93c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.412976] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-39122a3d-a49b-4abc-abfc-aa7bec83e93c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.413245] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-39122a3d-a49b-4abc-abfc-aa7bec83e93c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.413390] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39122a3d-a49b-4abc-abfc-aa7bec83e93c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.429061] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.429290] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.429417] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.429714] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.429872] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.430033] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 39122a3d-a49b-4abc-abfc-aa7bec83e93c not found, creating... [ 1329.430272] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.430425] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.430541] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.430763] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.430948] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.431246] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.431394] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.431551] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.431790] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.431967] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.432140] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 39122a3d-a49b-4abc-abfc-aa7bec83e93c is going to be created. [ 1329.455660] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.455958] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.456199] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.456587] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.456931] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.457266] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-39122a3d-a49b-4abc-abfc-aa7bec83e93c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.671322] env[61817]: INFO networking_nsxv3.common.synchronization [req-e2dacbe9-402b-42c1-803f-4545a5563227 req-b581b99d-75c5-4e8b-b0ad-cad3685ea68f service neutron] Enqueued Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGHEST for action security_group_rules [ 1329.671507] env[61817]: INFO networking_nsxv3.common.synchronization [req-e2dacbe9-402b-42c1-803f-4545a5563227 req-b581b99d-75c5-4e8b-b0ad-cad3685ea68f service neutron] Enqueued Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGHEST for action security_group_members [ 1329.671651] env[61817]: INFO networking_nsxv3.common.synchronization [req-e2dacbe9-402b-42c1-803f-4545a5563227 req-b581b99d-75c5-4e8b-b0ad-cad3685ea68f service neutron] Enqueued Resource ID: 39122a3d-a49b-4abc-abfc-aa7bec83e93c with Priority: HIGHEST for action port [ 1329.672220] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGHEST for action security_group_rules [ 1329.672357] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGHEST for action security_group_members [ 1329.672456] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39122a3d-a49b-4abc-abfc-aa7bec83e93c with Priority: HIGHEST for action port [ 1329.672741] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.672866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.672936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.673142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.673228] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.673375] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.673464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.673526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.673723] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.673802] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.674796] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.674922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.674992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.675146] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.675224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.675916] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.676058] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.676126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.676700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.676856] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.676958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.677024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.677169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.677290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.677357] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.678213] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.678293] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.678335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.678466] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.678546] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.678686] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-39122a3d-a49b-4abc-abfc-aa7bec83e93c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.678819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39122a3d-a49b-4abc-abfc-aa7bec83e93c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.679012] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39122a3d-a49b-4abc-abfc-aa7bec83e93c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.679190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39122a3d-a49b-4abc-abfc-aa7bec83e93c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.679275] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39122a3d-a49b-4abc-abfc-aa7bec83e93c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.696233] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.711444] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.711672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.711672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.711874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.711970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.712159] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.712235] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.713980] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39122a3d-a49b-4abc-abfc-aa7bec83e93c with status ACTIVE [ 1329.714156] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.714264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.714352] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.714535] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.714622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.714784] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.714888] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.714964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.715113] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.715192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.716830] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.724761] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.724955] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.725004] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.725182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.725276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.725772] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1620446-f273-4658-baad-13a497dabc74 is going to be created. [ 1329.756275] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.756478] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1329.756478] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1329.756694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1329.756887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1329.767554] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1620446-f273-4658-baad-13a497dabc74 in Status: UNINITIALIZED for 2s [ 1330.104424] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.104644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1330.104644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1330.104863] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1330.104957] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1330.105053] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39122a3d-a49b-4abc-abfc-aa7bec83e93c is going to be updated. [ 1330.132219] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.132482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1330.132482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1330.132697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1330.132880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1330.133155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39122a3d-a49b-4abc-abfc-aa7bec83e93c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.777209] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1620446-f273-4658-baad-13a497dabc74 in Status: SUCCESS [ 1331.777549] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.777612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.777805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.777995] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.778115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1331.778169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.778326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.778407] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.778681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.778681] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.787894] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.788044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1331.788119] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.788300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.788381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.788534] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.788633] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1331.788719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.788849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.788986] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.789084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1331.789135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.789276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.789354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.789436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.789584] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.789682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1331.789742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.789880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.789956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.790094] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.790183] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1331.790244] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.790382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.790515] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.790604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1331.790665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.790835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.790936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.791020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.791106] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.801178] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1620446-f273-4658-baad-13a497dabc74: rpc.has_security_group_logging(os_id): False [ 1331.818733] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.818888] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1331.818939] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.819122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.819213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.819400] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.819501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1331.819566] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.820029] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.820029] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.820029] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.820183] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1331.820183] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.820285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.820360] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.820542] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.820634] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1331.820697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.820856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.820937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.821022] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1620446-f273-4658-baad-13a497dabc74 is going to be created. [ 1331.881231] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.881376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1331.881447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1331.881659] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1331.881855] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1331.894418] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1620446-f273-4658-baad-13a497dabc74 in Status: IN_PROGRESS for 2s [ 1333.908037] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1620446-f273-4658-baad-13a497dabc74 in Status: SUCCESS [ 1333.908316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1334.673884] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1334.674018] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.031679] env[61817]: INFO networking_nsxv3.common.synchronization [None req-7149d400-5ca2-4488-9674-942b825f6dd9 None None] Enqueued Resource ID: 53a5b2ef-1468-4126-b836-a7767d50cd3f with Priority: HIGHEST for action port [ 1335.031959] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a5b2ef-1468-4126-b836-a7767d50cd3f with Priority: HIGHEST for action port [ 1335.032566] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.032719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1335.032800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1335.033006] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1335.033091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1335.033275] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-53a5b2ef-1468-4126-b836-a7767d50cd3f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.033375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53a5b2ef-1468-4126-b836-a7767d50cd3f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1335.033438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53a5b2ef-1468-4126-b836-a7767d50cd3f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1335.033628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53a5b2ef-1468-4126-b836-a7767d50cd3f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1335.033713] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53a5b2ef-1468-4126-b836-a7767d50cd3f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.076300] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53a5b2ef-1468-4126-b836-a7767d50cd3f [ 1335.079571] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.079571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1335.079571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1335.079571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1335.079571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1335.079571] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53a5b2ef-1468-4126-b836-a7767d50cd3f already deleted. [ 1335.079571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53a5b2ef-1468-4126-b836-a7767d50cd3f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1337.172722] env[61817]: INFO networking_nsxv3.common.synchronization [None req-b853397e-9a24-44ce-9fb7-42eb58d2dec6 None None] Enqueued Resource ID: d0500e7e-0393-405e-ace4-71d01eb42f4e with Priority: HIGHEST for action port [ 1337.173228] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0500e7e-0393-405e-ace4-71d01eb42f4e with Priority: HIGHEST for action port [ 1337.173534] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.173687] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1337.173759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1337.173994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1337.174055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1337.174202] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0500e7e-0393-405e-ace4-71d01eb42f4e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.174298] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0500e7e-0393-405e-ace4-71d01eb42f4e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1337.174359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0500e7e-0393-405e-ace4-71d01eb42f4e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1337.174557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0500e7e-0393-405e-ace4-71d01eb42f4e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1337.174641] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0500e7e-0393-405e-ace4-71d01eb42f4e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.186074] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0500e7e-0393-405e-ace4-71d01eb42f4e [ 1337.186232] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.186377] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1337.186453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1337.186666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1337.186762] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1337.186858] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0500e7e-0393-405e-ace4-71d01eb42f4e already deleted. [ 1337.186969] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0500e7e-0393-405e-ace4-71d01eb42f4e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1342.174812] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1342.174812] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1347.176031] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.176431] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1352.177535] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1352.177911] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1357.178536] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1357.178843] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1362.180014] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1362.180265] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1367.181036] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1367.181397] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1372.182320] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.182661] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.183393] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.183717] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.800087] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f939953-a7cb-4e7b-b906-184203fbc784 req-ce65372c-188f-4ada-b80c-9212c0da5bf1 tempest-ServersTestMultiNic-969860196 tempest-ServersTestMultiNic-969860196-project-member] Enqueued Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_members [ 1377.800606] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_members [ 1377.800954] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.801081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1377.801169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1377.801372] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1377.801479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1377.801665] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.801764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1377.801828] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1377.801995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1377.802127] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.802217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1377.802275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1377.802409] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1377.802488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1377.802574] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.816743] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.828681] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.836636] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.836779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1377.836846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1377.837056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1377.837149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1377.837240] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 is going to be updated. [ 1377.868775] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.868940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1377.869301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1377.869301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1377.869411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1377.879972] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: IN_PROGRESS for 2s [ 1378.047628] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f939953-a7cb-4e7b-b906-184203fbc784 req-1a4f7dd3-c235-424b-906b-68b42b8813b5 tempest-ServersTestMultiNic-969860196 tempest-ServersTestMultiNic-969860196-project-member] Enqueued Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_members [ 1378.047628] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGHEST for action security_group_members [ 1378.047628] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.047628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1378.047628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1378.047628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1378.047628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1378.047628] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.047628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1379.566008] env[61817]: INFO networking_nsxv3.common.synchronization [req-70200a54-aa7c-4c22-8bc4-77b36bf87bbd req-8728be7f-be93-44fc-979c-c03439427550 tempest-ImagesTestJSON-1042540315 tempest-ImagesTestJSON-1042540315-project-member] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 1379.566570] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 1379.566891] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.566996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1379.567063] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1379.567255] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1379.567336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1379.567553] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.567612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1379.567612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1379.568071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1379.568223] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.568325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1379.568384] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1379.568526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1379.568625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1379.568687] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.579083] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.589800] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.596371] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.596520] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1379.596585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1379.596777] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1379.596866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1379.596963] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1379.627071] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.627214] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1379.627289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1379.627492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1379.627976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1379.637335] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1379.894748] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: SUCCESS [ 1379.894969] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1379.895136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1379.895349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1379.895535] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.895656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1379.895730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1379.895865] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1379.895939] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1379.896070] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.912464] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.912608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1379.912675] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1379.912876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1379.912971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1379.913156] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.913254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1379.913316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1379.913462] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1379.913540] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1379.913627] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 is going to be updated. [ 1379.948456] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.948619] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1379.948672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1379.949533] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1379.949533] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1379.958316] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: IN_PROGRESS for 2s [ 1380.067234] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.067434] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.067559] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.067848] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.067999] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.068286] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-16 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.068444] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.068556] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.068802] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.069083] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.069238] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.069352] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.069566] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.069706] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.069852] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.070104] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.070252] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.070365] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.070566] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.070696] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.070979] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-e00269ab-f36b-459f-ba1b-6468a5dd675c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.071135] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-e00269ab-f36b-459f-ba1b-6468a5dd675c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.071250] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-e00269ab-f36b-459f-ba1b-6468a5dd675c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.071512] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-e00269ab-f36b-459f-ba1b-6468a5dd675c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.071649] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e00269ab-f36b-459f-ba1b-6468a5dd675c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.089574] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.089780] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.089903] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.090179] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.090330] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.090673] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port e00269ab-f36b-459f-ba1b-6468a5dd675c not found, creating... [ 1380.091339] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.091529] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.091654] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.091899] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.092097] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.092407] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.092569] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.092688] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.092903] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.093042] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.093186] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: e00269ab-f36b-459f-ba1b-6468a5dd675c is going to be created. [ 1380.117344] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.117568] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.117692] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.117959] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.118186] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.118407] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-e00269ab-f36b-459f-ba1b-6468a5dd675c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.770950] env[61817]: INFO networking_nsxv3.common.synchronization [req-70200a54-aa7c-4c22-8bc4-77b36bf87bbd req-198335f4-9a4d-4c24-9cfc-56b006d9121c service neutron] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_rules [ 1380.771241] env[61817]: INFO networking_nsxv3.common.synchronization [req-70200a54-aa7c-4c22-8bc4-77b36bf87bbd req-198335f4-9a4d-4c24-9cfc-56b006d9121c service neutron] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 1380.771293] env[61817]: INFO networking_nsxv3.common.synchronization [req-70200a54-aa7c-4c22-8bc4-77b36bf87bbd req-198335f4-9a4d-4c24-9cfc-56b006d9121c service neutron] Enqueued Resource ID: e00269ab-f36b-459f-ba1b-6468a5dd675c with Priority: HIGHEST for action port [ 1380.771517] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_rules [ 1380.771634] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 1380.771727] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e00269ab-f36b-459f-ba1b-6468a5dd675c with Priority: HIGHEST for action port [ 1380.772315] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.772436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.772501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.772695] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.772776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.772919] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.773009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.773066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.773206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.773278] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.775377] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.775608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.775670] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.775846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.775886] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.776042] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.776118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.776306] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.776394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.776453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.776591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.776660] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.776790] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-e00269ab-f36b-459f-ba1b-6468a5dd675c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.776881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e00269ab-f36b-459f-ba1b-6468a5dd675c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.776936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e00269ab-f36b-459f-ba1b-6468a5dd675c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.777066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e00269ab-f36b-459f-ba1b-6468a5dd675c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.777136] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e00269ab-f36b-459f-ba1b-6468a5dd675c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.793005] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.793191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.793255] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.793445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.793523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.793685] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.793761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.795236] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e00269ab-f36b-459f-ba1b-6468a5dd675c with status ACTIVE [ 1380.795395] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.795496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.795553] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.795711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.796265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.796434] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.796526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.796585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.796726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.796800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.880150] env[61817]: INFO networking_nsxv3.common.synchronization [None req-67b1ca29-5d6e-4341-8ca0-79423dd32d0e None None] Enqueued Resource ID: 245766de-301c-41fc-aded-71cb9912f26e with Priority: HIGHEST for action port [ 1380.880510] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245766de-301c-41fc-aded-71cb9912f26e with Priority: HIGHEST for action port [ 1380.881172] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.881290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.881354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.881543] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.881622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.881770] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-245766de-301c-41fc-aded-71cb9912f26e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.881857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-245766de-301c-41fc-aded-71cb9912f26e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.881914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-245766de-301c-41fc-aded-71cb9912f26e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.882103] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-245766de-301c-41fc-aded-71cb9912f26e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.882177] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('245766de-301c-41fc-aded-71cb9912f26e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.893231] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 245766de-301c-41fc-aded-71cb9912f26e [ 1380.893445] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.893569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1380.893635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1380.893832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1380.893916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1380.894036] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:245766de-301c-41fc-aded-71cb9912f26e already deleted. [ 1380.894080] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-245766de-301c-41fc-aded-71cb9912f26e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1381.180561] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.180561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1381.180561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1381.180561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1381.180561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1381.180561] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e00269ab-f36b-459f-ba1b-6468a5dd675c is going to be updated. [ 1381.204421] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.204421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1381.204421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1381.204620] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1381.204685] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1381.204857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e00269ab-f36b-459f-ba1b-6468a5dd675c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1381.649142] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1381.649361] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1381.649526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1381.649736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1381.649917] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.650027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1381.650090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1381.650230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1381.650309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1381.650396] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.658593] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.668910] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.683373] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.683493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1381.683534] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1381.683747] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1381.683840] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1381.683939] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1381.715594] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.715594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1381.715801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1381.715905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1381.716065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1381.726360] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1381.968586] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd22888a-f333-48c2-a433-ab2abba8ae54 in Status: SUCCESS [ 1381.968937] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 deletion is rescheduled due to dependency. [ 1381.968937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1382.729010] env[61817]: INFO networking_nsxv3.common.synchronization [None req-77e06114-c9d4-4dab-8bb5-86f34e8d76a0 None None] Enqueued Resource ID: 2aa677c5-a494-404c-ac00-0c9f6211eaae with Priority: HIGHEST for action port [ 1382.729260] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa677c5-a494-404c-ac00-0c9f6211eaae with Priority: HIGHEST for action port [ 1382.729807] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.729938] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1382.730002] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1382.730200] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1382.731489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1382.731489] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-2aa677c5-a494-404c-ac00-0c9f6211eaae taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.731489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2aa677c5-a494-404c-ac00-0c9f6211eaae" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1382.731489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2aa677c5-a494-404c-ac00-0c9f6211eaae" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1382.731489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2aa677c5-a494-404c-ac00-0c9f6211eaae" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1382.731489] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aa677c5-a494-404c-ac00-0c9f6211eaae',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.751981] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2aa677c5-a494-404c-ac00-0c9f6211eaae [ 1382.752209] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.752329] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1382.752397] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1382.752587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1382.752678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1382.752769] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2aa677c5-a494-404c-ac00-0c9f6211eaae already deleted. [ 1382.752848] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2aa677c5-a494-404c-ac00-0c9f6211eaae" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.736196] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1383.736458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.736575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.736764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.736953] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.737129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1383.737376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.737376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.737457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.737457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.737604] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.747312] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.747454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1383.747514] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.747726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.747776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.747915] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.748022] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1383.748083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.748226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.748363] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.748453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1383.748513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.748648] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.748723] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.748801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.749019] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.749111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1383.749198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.749339] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.749412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.749574] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.749700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1383.749759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.749892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.750019] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.750103] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1383.750340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.750492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.750611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.750710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.750797] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.757092] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a2644aa-f99a-4b14-9145-702ba5c8452b: rpc.has_security_group_logging(os_id): False [ 1383.776632] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.776830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1383.776941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.777271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.777438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.777709] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.777815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1383.777879] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.778100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.778165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.778418] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.778572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1383.778688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.778887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.778970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.779178] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.779360] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1383.779473] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.779625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.779778] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.779778] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1383.839364] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.839482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1383.839572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1383.839754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1383.839902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1383.854259] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1385.869252] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1385.869602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1387.730799] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.730799] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1392.732353] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.732637] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.734096] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.734096] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.735589] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.735874] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.737250] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.737615] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.738170] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.738513] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1417.740198] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.740487] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1422.741376] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.741693] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.912534] env[61817]: INFO networking_nsxv3.common.synchronization [req-5baa18af-c69b-41ca-8a11-082d298d37de req-3895575a-56d9-4a8a-a9cb-3bc20f95170e tempest-ImagesTestJSON-1042540315 tempest-ImagesTestJSON-1042540315-project-member] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 1426.913064] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 1426.913735] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.913872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1426.913960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1426.914183] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1426.914274] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1426.914436] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.914530] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1426.914599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1426.914749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1426.914886] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.914986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1426.915054] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1426.915199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1426.915280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1426.915373] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.926352] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.935277] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.942750] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.942880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1426.942952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1426.943198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1426.943251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1426.943336] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1426.988968] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.989175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1426.989221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1426.989621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1426.989800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1427.001875] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1428.017869] env[61817]: INFO networking_nsxv3.common.synchronization [req-fa2268ed-9286-4836-8782-67c19dd836dd req-73c0bfd5-f2a6-4dcf-b848-020e331ffe79 tempest-AttachVolumeNegativeTest-329748670 tempest-AttachVolumeNegativeTest-329748670-project-member] Enqueued Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGHEST for action security_group_members [ 1428.018468] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGHEST for action security_group_members [ 1428.018938] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.019115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.019215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.019461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.019549] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.019708] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.019808] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.019873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.020083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.020231] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.020321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.020383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.020524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.020605] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.020695] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.038027] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.038027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.038027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.038027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.039302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.039302] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.039302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.039302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.039302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.039302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.039302] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e583f7e5-364a-4a33-9784-9c313528bb3d already deleted. [ 1428.039302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.312388] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.312590] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.312711] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.313026] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.313137] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.313366] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-324 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.313517] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-324" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.313660] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-324" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.313839] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-324" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.314075] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.314318] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.314379] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.314544] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.314689] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.314840] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-324" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.315090] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.315244] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.315358] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.315566] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.315700] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.315935] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-c470b894-7a78-4581-a4a4-b964432c328b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.316106] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-c470b894-7a78-4581-a4a4-b964432c328b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.316226] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-c470b894-7a78-4581-a4a4-b964432c328b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.316498] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-c470b894-7a78-4581-a4a4-b964432c328b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.316641] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c470b894-7a78-4581-a4a4-b964432c328b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.335307] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.335538] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.335668] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.335948] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.336131] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.336288] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port c470b894-7a78-4581-a4a4-b964432c328b not found, creating... [ 1428.336549] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.336706] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.336828] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.337070] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.337228] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.337511] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.337672] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.337794] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.338008] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.338280] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.338432] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: c470b894-7a78-4581-a4a4-b964432c328b is going to be created. [ 1428.365831] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.365831] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.365831] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.365831] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.365831] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.365831] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-c470b894-7a78-4581-a4a4-b964432c328b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.598141] env[61817]: INFO networking_nsxv3.common.synchronization [req-fa2268ed-9286-4836-8782-67c19dd836dd req-139715ea-f7ce-48e7-b2e6-1ea62140ec5e service neutron] Enqueued Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGHEST for action security_group_rules [ 1428.598327] env[61817]: INFO networking_nsxv3.common.synchronization [req-fa2268ed-9286-4836-8782-67c19dd836dd req-139715ea-f7ce-48e7-b2e6-1ea62140ec5e service neutron] Enqueued Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGHEST for action security_group_members [ 1428.598472] env[61817]: INFO networking_nsxv3.common.synchronization [req-fa2268ed-9286-4836-8782-67c19dd836dd req-139715ea-f7ce-48e7-b2e6-1ea62140ec5e service neutron] Enqueued Resource ID: c470b894-7a78-4581-a4a4-b964432c328b with Priority: HIGHEST for action port [ 1428.598701] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGHEST for action security_group_rules [ 1428.598829] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGHEST for action security_group_members [ 1428.598925] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c470b894-7a78-4581-a4a4-b964432c328b with Priority: HIGHEST for action port [ 1428.599466] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.599606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.599676] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.599881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.599967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.600146] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.600242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.600294] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.600449] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.600527] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.601424] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.601529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.601529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.601661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.601869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.602011] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.602099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.602160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.602299] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.602431] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.602518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.602577] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.602712] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.602822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.602866] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.603992] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.604117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.604187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.606380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.606380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.606380] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-c470b894-7a78-4581-a4a4-b964432c328b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.606380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c470b894-7a78-4581-a4a4-b964432c328b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.606380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c470b894-7a78-4581-a4a4-b964432c328b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.606380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c470b894-7a78-4581-a4a4-b964432c328b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.606380] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c470b894-7a78-4581-a4a4-b964432c328b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.615280] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.635445] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.635639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.635679] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.635868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.635953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.636141] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.636227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.642292] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.651479] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.651634] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.651707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.651915] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.652068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.652158] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e583f7e5-364a-4a33-9784-9c313528bb3d is going to be created. [ 1428.656156] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c470b894-7a78-4581-a4a4-b964432c328b with status ACTIVE [ 1428.656373] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.656498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.656566] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.656753] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.656846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.657017] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.657113] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.657174] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.657318] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.657394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.736606] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.736832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1428.736832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1428.737113] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1428.737253] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1428.752407] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e583f7e5-364a-4a33-9784-9c313528bb3d in Status: UNINITIALIZED for 2s [ 1429.015430] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1429.015649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1429.143771] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.144199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1429.144199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1429.144370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1429.144370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1429.144480] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c470b894-7a78-4581-a4a4-b964432c328b is going to be updated. [ 1429.169901] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.170068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1429.170118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1429.170338] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1429.170469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1429.170628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c470b894-7a78-4581-a4a4-b964432c328b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1430.762927] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e583f7e5-364a-4a33-9784-9c313528bb3d in Status: SUCCESS [ 1430.763307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1430.763307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1430.763493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1430.763682] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.763812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1430.763879] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1430.764057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1430.764142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1430.764227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1430.764315] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.773737] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.779774] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e583f7e5-364a-4a33-9784-9c313528bb3d: rpc.has_security_group_logging(os_id): False [ 1430.799605] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.799807] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1430.799855] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1430.800054] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1430.800153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1430.800403] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.800506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1430.800570] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1430.800729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1430.800811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1430.800979] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e583f7e5-364a-4a33-9784-9c313528bb3d is going to be created. [ 1430.877277] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.877438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1430.877511] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1430.877731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1430.877921] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1430.891088] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e583f7e5-364a-4a33-9784-9c313528bb3d in Status: IN_PROGRESS for 2s [ 1432.906069] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e583f7e5-364a-4a33-9784-9c313528bb3d in Status: SUCCESS [ 1432.906414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1433.599786] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.599991] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.600513] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.600820] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.601485] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.601805] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.603025] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.603435] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.603847] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.604334] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.604960] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.604960] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.904231] env[61817]: INFO networking_nsxv3.common.synchronization [None req-d884156c-5268-4116-8481-48b19e717221 None None] Enqueued Resource ID: 8603164e-3dee-46f8-a72b-154d44401211 with Priority: HIGHEST for action port [ 1461.904506] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8603164e-3dee-46f8-a72b-154d44401211 with Priority: HIGHEST for action port [ 1461.905068] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.905202] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1461.905267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1461.905482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1461.905568] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1461.905721] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-8603164e-3dee-46f8-a72b-154d44401211 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.905816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8603164e-3dee-46f8-a72b-154d44401211" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1461.905872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8603164e-3dee-46f8-a72b-154d44401211" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1461.906070] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8603164e-3dee-46f8-a72b-154d44401211" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1461.906175] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8603164e-3dee-46f8-a72b-154d44401211',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.061422] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8603164e-3dee-46f8-a72b-154d44401211 [ 1462.061622] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.061751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1462.061804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1462.062017] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1462.062105] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1462.062192] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8603164e-3dee-46f8-a72b-154d44401211 already deleted. [ 1462.062267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8603164e-3dee-46f8-a72b-154d44401211" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1462.496232] env[61817]: INFO networking_nsxv3.common.synchronization [None req-0f163836-352b-4ed8-b388-d1ec6e304e09 tempest-ServerActionsTestJSON-100355986 tempest-ServerActionsTestJSON-100355986-project-member] Enqueued Resource ID: 656294ce-3028-456f-bea4-645a3560e553 with Priority: HIGHEST for action security_group_rules [ 1462.496232] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656294ce-3028-456f-bea4-645a3560e553 with Priority: HIGHEST for action security_group_rules [ 1462.496232] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.496232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1462.496232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1462.496232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1462.496232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1462.496232] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-656294ce-3028-456f-bea4-645a3560e553 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.496232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-656294ce-3028-456f-bea4-645a3560e553" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1462.496232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-656294ce-3028-456f-bea4-645a3560e553" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1462.496232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-656294ce-3028-456f-bea4-645a3560e553" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1462.496232] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('656294ce-3028-456f-bea4-645a3560e553',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.529154] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.529325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1462.529325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1462.529523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1462.529618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1462.529715] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 656294ce-3028-456f-bea4-645a3560e553 already deleted. [ 1462.529800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-656294ce-3028-456f-bea4-645a3560e553" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1462.582603] env[61817]: INFO networking_nsxv3.common.synchronization [None req-419d7a59-0f14-427e-ab21-b8081fdf8b53 tempest-ServerActionsTestJSON-100355986 tempest-ServerActionsTestJSON-100355986-project-member] Enqueued Resource ID: 656294ce-3028-456f-bea4-645a3560e553 with Priority: HIGHEST for action security_group_rules [ 1462.583095] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656294ce-3028-456f-bea4-645a3560e553 with Priority: HIGHEST for action security_group_rules [ 1462.583993] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.583993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1462.583993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1462.584192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1462.584271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1462.584428] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-656294ce-3028-456f-bea4-645a3560e553 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.584517] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-656294ce-3028-456f-bea4-645a3560e553" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1462.584576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-656294ce-3028-456f-bea4-645a3560e553" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1462.584746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-656294ce-3028-456f-bea4-645a3560e553" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1462.584821] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('656294ce-3028-456f-bea4-645a3560e553',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.616132] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.616304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1462.616479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1462.616628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1462.616738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1462.616817] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 656294ce-3028-456f-bea4-645a3560e553 already deleted. [ 1462.616968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-656294ce-3028-456f-bea4-645a3560e553" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1463.924681] env[61817]: INFO networking_nsxv3.common.synchronization [None req-96671ee1-7aa2-4589-bda7-499415548f89 None None] Enqueued Resource ID: 7b1ce3f0-8ade-4e07-bba3-8ac456cc211f with Priority: HIGHEST for action port [ 1463.924944] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b1ce3f0-8ade-4e07-bba3-8ac456cc211f with Priority: HIGHEST for action port [ 1463.925483] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.925607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1463.925675] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1463.925873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1463.925960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1463.926125] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b1ce3f0-8ade-4e07-bba3-8ac456cc211f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.926223] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b1ce3f0-8ade-4e07-bba3-8ac456cc211f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1463.926285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b1ce3f0-8ade-4e07-bba3-8ac456cc211f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1463.926479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b1ce3f0-8ade-4e07-bba3-8ac456cc211f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1463.926559] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b1ce3f0-8ade-4e07-bba3-8ac456cc211f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.934854] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b1ce3f0-8ade-4e07-bba3-8ac456cc211f [ 1463.935062] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.935131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1463.935169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1463.935373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1463.935461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1463.935549] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b1ce3f0-8ade-4e07-bba3-8ac456cc211f already deleted. [ 1463.935625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b1ce3f0-8ade-4e07-bba3-8ac456cc211f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1468.926466] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1468.926870] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1473.927322] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1473.927566] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.707384] env[61817]: INFO networking_nsxv3.common.synchronization [req-c6fa9317-8d61-4b3a-858d-58f325837a54 req-4fc3eaa1-7e01-42a1-8ff5-ddd495a1252a tempest-ServerActionsTestOtherB-280984654 tempest-ServerActionsTestOtherB-280984654-project-member] Enqueued Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGHEST for action security_group_members [ 1476.707919] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGHEST for action security_group_members [ 1476.708272] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.708382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1476.708439] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1476.708635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1476.708714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1476.708869] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.708980] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1476.709039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1476.709190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1476.709324] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.709409] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1476.709466] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1476.709597] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1476.709672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1476.709756] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.720913] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.721045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1476.721094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1476.721290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1476.721488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1476.721676] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.721773] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1476.721837] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1476.722034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1476.722108] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1476.722194] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a is going to be updated. [ 1476.755886] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.756597] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1476.756864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1476.757355] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1476.757654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1476.770115] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a in Status: IN_PROGRESS for 2s [ 1477.002098] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1477.002233] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1478.002328] env[61817]: INFO networking_nsxv3.common.synchronization [req-54b434c0-87a4-4acf-9495-f33d6d936275 req-c631969a-d275-4cab-ab36-2076cb457659 tempest-DeleteServersTestJSON-1745478556 tempest-DeleteServersTestJSON-1745478556-project-member] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1478.002847] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1478.003155] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.003292] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.003357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.003571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.003701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.003797] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.003899] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.003963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.004107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.004550] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.004639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.004705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.004848] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.004942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.005016] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.014140] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.014250] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.014320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.014491] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.014575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.014744] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.014835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.014896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.015035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.015110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.015241] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 1478.041004] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.041219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.041219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.041423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.041562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.050512] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1478.296767] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.296975] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.297129] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.297816] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.297816] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.297816] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-455 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.298013] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.298119] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.298343] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.299159] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.299345] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.299471] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.299691] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.299839] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.299993] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.300309] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.300473] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.300725] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.301069] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.301220] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.301467] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-cf9bf805-41cf-448d-a0f9-2b1a47751b22 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.301625] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-cf9bf805-41cf-448d-a0f9-2b1a47751b22" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.301745] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-cf9bf805-41cf-448d-a0f9-2b1a47751b22" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.302040] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-cf9bf805-41cf-448d-a0f9-2b1a47751b22" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.302185] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf9bf805-41cf-448d-a0f9-2b1a47751b22',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.318087] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.318351] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.318482] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.318920] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.319033] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.319203] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port cf9bf805-41cf-448d-a0f9-2b1a47751b22 not found, creating... [ 1478.319483] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.319649] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.319770] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.320020] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.320199] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.320500] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.320662] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.320782] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.321101] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.321255] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.321410] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: cf9bf805-41cf-448d-a0f9-2b1a47751b22 is going to be created. [ 1478.346791] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.347005] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.347125] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.347403] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.347633] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.347853] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-cf9bf805-41cf-448d-a0f9-2b1a47751b22" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.573078] env[61817]: INFO networking_nsxv3.common.synchronization [req-54b434c0-87a4-4acf-9495-f33d6d936275 req-2b2c8bb3-a002-4dd9-9074-a8fd270535e6 service neutron] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_rules [ 1478.573078] env[61817]: INFO networking_nsxv3.common.synchronization [req-54b434c0-87a4-4acf-9495-f33d6d936275 req-2b2c8bb3-a002-4dd9-9074-a8fd270535e6 service neutron] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1478.573078] env[61817]: INFO networking_nsxv3.common.synchronization [req-54b434c0-87a4-4acf-9495-f33d6d936275 req-2b2c8bb3-a002-4dd9-9074-a8fd270535e6 service neutron] Enqueued Resource ID: cf9bf805-41cf-448d-a0f9-2b1a47751b22 with Priority: HIGHEST for action port [ 1478.573078] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_rules [ 1478.573078] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1478.573078] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf9bf805-41cf-448d-a0f9-2b1a47751b22 with Priority: HIGHEST for action port [ 1478.573078] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.573078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.573078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.573078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.573078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.573078] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.573078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.573078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.573078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.573078] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.575014] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.575014] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.575204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.575274] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.576026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.576026] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.576026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.576026] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.576026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.576026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.576026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.576336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.576336] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf9bf805-41cf-448d-a0f9-2b1a47751b22 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.576336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf9bf805-41cf-448d-a0f9-2b1a47751b22" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.576458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf9bf805-41cf-448d-a0f9-2b1a47751b22" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.576543] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf9bf805-41cf-448d-a0f9-2b1a47751b22" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.576582] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf9bf805-41cf-448d-a0f9-2b1a47751b22',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.593241] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.593405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.593513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.593730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.593821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.594134] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.594134] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.597531] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf9bf805-41cf-448d-a0f9-2b1a47751b22 with status ACTIVE [ 1478.597714] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.597824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.597892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.598072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.598163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.598334] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.598426] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1478.598491] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1478.598632] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1478.598711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1478.782876] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a in Status: SUCCESS [ 1478.783062] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a deletion is rescheduled due to dependency. [ 1478.783195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1479.058770] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.059295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1479.059295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1479.059295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1479.059295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1479.059445] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf9bf805-41cf-448d-a0f9-2b1a47751b22 is going to be updated. [ 1479.082862] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.083045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1479.083090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1479.083314] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1479.083462] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1479.083633] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf9bf805-41cf-448d-a0f9-2b1a47751b22" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1480.061100] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1480.061537] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 deletion is rescheduled due to dependency. [ 1480.061537] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1480.061537] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1480.061739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1480.061922] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.062151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1480.062151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1480.062287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1480.062346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1480.062402] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1480.069414] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1480.076877] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1480.084048] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.084243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1480.084243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1480.084435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1480.084523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1480.084618] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 1480.112988] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.113261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1480.113261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1480.113439] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1480.113580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1480.123402] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1481.828808] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.829204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1481.829204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1481.829281] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1481.829326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1481.829505] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.829609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1481.829669] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1481.829815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1481.829919] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.838507] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.849368] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.856038] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1481.856157] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1482.152654] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1482.152871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.153037] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.153256] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.153443] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.153560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.153625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.153773] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.153858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.153942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.154032] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.163658] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.163809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.163854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.164026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.164112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.164264] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.164357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.164412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.164660] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.164745] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.164805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.164844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.164965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.165047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.165125] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.165272] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.165366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.165807] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.166014] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.166085] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.166250] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.166337] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.166399] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.166544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.166680] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.166765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.166824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.166959] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.167037] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.167117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.167201] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.174157] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0: rpc.has_security_group_logging(os_id): False [ 1482.192756] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.192942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.192989] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.193203] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.193320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.193519] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.193645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.193710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.193894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.193986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.194219] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.194323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.194383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.194556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.194633] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.194854] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.194960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.195023] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.195193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.195272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.195359] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 1482.276770] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.277008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.277008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.277198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.277354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.290463] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1482.679911] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.680376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.680568] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.680948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.694013] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1482.694767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.695673] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1482.721763] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.722119] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.722295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.722582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.728737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.729316] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1482.729511] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1482.729689] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1482.754113] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.754462] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.754629] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.754927] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.755581] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.755814] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1482.802499] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.802856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.803034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.803346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.803702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.804000] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1482.849464] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.850041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.850241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.850535] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.850819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.851174] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:13. [ 1482.851359] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b1620446-f273-4658-baad-13a497dabc74', 'bd22888a-f333-48c2-a433-ab2abba8ae54', '3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b', 'e583f7e5-364a-4a33-9784-9c313528bb3d', 'a3ac00c4-e41d-4288-b6b9-01b5f4714e5a', '3ffcb57e-8678-415b-bd13-19b60dbd45bd', '6d193cbd-452d-400d-b88e-58fc27978848', '9f129921-ca53-4911-9bcc-7d661d45384d', 'bbf8f627-b3e9-41d3-bf72-822741bb5374', '62ddbcee-1db4-4515-8d5b-c25d44008cc0', '8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0', '5a2644aa-f99a-4b14-9145-702ba5c8452b', '5233168b-5f93-4bb0-bac2-dd279d965d46'} {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1482.851570] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1482.872080] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.872260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.872317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.872522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.872606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.872712] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1482.872782] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1482.872852] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1482.919085] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.919209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.919276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.919473] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.919931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.920162] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1482.920229] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1482.920300] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1482.920362] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1482.920433] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 13/13 resources of Type:Security Group Rules [ 1482.920500] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGH for action security_group_rules [ 1482.920591] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGH for action security_group_rules [ 1482.920635] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGH for action security_group_rules [ 1482.920694] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGH for action security_group_rules [ 1482.920752] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGH for action security_group_rules [ 1482.920855] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 1482.920855] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGH for action security_group_rules [ 1482.920977] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGH for action security_group_rules [ 1482.921058] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGH for action security_group_rules [ 1482.921058] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGH for action security_group_rules [ 1482.921130] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 1482.921197] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 1482.921261] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 1482.921325] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1482.921386] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1482.921560] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.921664] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.921732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.921952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.922120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.922322] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.922424] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.922486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.922646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.922718] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.922884] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.922975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.923124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.923177] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.923300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.923463] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.923549] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.923604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.924454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.924454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.924454] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.924454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.924454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.924454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.924454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.924454] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.924971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.924971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.924971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.924971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.924971] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.925145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.925145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.925286] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.925286] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.925392] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.925458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.925512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.925636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.925740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.925907] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.925993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.926047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.926177] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.926243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.926402] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.926487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.926541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.926668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.926734] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.926885] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.926967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.927021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.927149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.927211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.927358] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.927440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.927494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.927617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.927682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.927833] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.927914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.927967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.928106] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.928234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.928515] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.928625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.928764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.928890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.928950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.929114] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.929203] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.929257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.929395] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.929464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.929621] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.929706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.929761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.929890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.929958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.930158] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.930313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.930313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.930399] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.930433] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.930592] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.930672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.930725] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.930852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.931084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.931310] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.931427] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.931532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.931651] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.931758] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.932060] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.932246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.932246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.932386] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.932460] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.932626] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.932713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.932766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.932905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.933001] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.933167] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.933254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.933311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.933445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.933512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.933665] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.933749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.933803] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.933929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.933996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.934146] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.934229] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.934283] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.934409] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.934476] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.934627] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.934710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.934763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.934895] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.934962] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.935175] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.935279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.935332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.935464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.935531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.935687] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.935802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.935861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.935989] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.936067] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.936221] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.936309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1482.936353] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1482.936480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1482.936546] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1482.936664] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:12 [ 1482.936728] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 7 of least updated resources [ 1482.936806] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e with Priority: HIGH for action port [ 1482.936889] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 151de087-3a41-4b53-b6d8-acc5a00d9c10 with Priority: HIGH for action port [ 1482.936954] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGH for action security_group_members [ 1482.937016] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d704867-786c-4653-bb82-7432f6f5dc3d with Priority: HIGH for action port [ 1482.937079] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGH for action security_group_members [ 1482.937141] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGH for action security_group_members [ 1482.937203] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGH for action security_group_members [ 1482.937290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.572143] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1483.572300] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=1 [ 1483.572385] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGH for action security_group_rules [ 1483.572512] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGH for action security_group_rules [ 1483.572611] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGH for action security_group_rules [ 1483.572709] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 151de087-3a41-4b53-b6d8-acc5a00d9c10 with Priority: HIGH for action port [ 1483.572804] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 with Priority: HIGH for action security_group_members [ 1483.572897] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 with Priority: HIGH for action security_group_members [ 1483.572986] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGH for action security_group_members [ 1483.573075] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d704867-786c-4653-bb82-7432f6f5dc3d with Priority: HIGH for action port [ 1483.573165] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e with Priority: HIGH for action port [ 1483.573287] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c with Priority: HIGH for action security_group_members [ 1483.573381] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 1483.573467] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 1483.573552] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 1483.573638] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGH for action security_group_rules [ 1483.573723] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGH for action security_group_rules [ 1483.573808] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 1483.573893] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGH for action security_group_rules [ 1483.573981] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGH for action security_group_rules [ 1483.574101] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGH for action security_group_rules [ 1483.574201] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGH for action security_group_rules [ 1483.574533] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.574665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.574730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.574939] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.575019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.575175] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.575285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.575349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.575497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.575572] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.576554] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.576663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.576728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.576877] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.576954] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.577092] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.577182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.577267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.577406] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.577475] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.578559] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.578923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.578923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.579101] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.579188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.579431] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.579536] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.579601] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.579749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.579821] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.580769] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.580945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.581019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.581172] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.581262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.581431] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-151de087-3a41-4b53-b6d8-acc5a00d9c10 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.581527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-151de087-3a41-4b53-b6d8-acc5a00d9c10" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.581587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-151de087-3a41-4b53-b6d8-acc5a00d9c10" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.581729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-151de087-3a41-4b53-b6d8-acc5a00d9c10" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.581800] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('151de087-3a41-4b53-b6d8-acc5a00d9c10',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.582527] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.582651] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.582682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.582830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.582904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.583053] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.583218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.583218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.583355] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.583483] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.583577] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.583636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.583771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.583847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.583926] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('916dc4e3-1bc8-4ba5-b319-d9d0dee54564',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.584627] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.584734] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.584800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.584947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.585045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.585159] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.585244] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.585303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.585443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.585570] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.585658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.585762] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.585851] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.585923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.586102] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9efe5fcd-faf9-44dd-ac10-abd106d2dc72',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.586786] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.586896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.586964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.587112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.587187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.587327] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.587419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.587480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.587619] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.587747] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.587975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.587975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.588087] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.588118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.588183] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.589113] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.589222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.589314] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.589430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.589526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.589667] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d704867-786c-4653-bb82-7432f6f5dc3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.589759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d704867-786c-4653-bb82-7432f6f5dc3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.589820] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d704867-786c-4653-bb82-7432f6f5dc3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.589958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d704867-786c-4653-bb82-7432f6f5dc3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.590029] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d704867-786c-4653-bb82-7432f6f5dc3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.590751] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.590893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.590939] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.591091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.591193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.591336] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.591430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.591504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.591653] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.591724] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.592660] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.592740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.592776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.592898] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.592977] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.593115] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.593205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.593267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.593406] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.593535] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.593625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.593684] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.593816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.593888] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.593970] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5573ccf-d866-40ac-9bb4-1fa04e91ef9c',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.594843] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.594976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.595044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.595196] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.595311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.595496] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.595628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.595660] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.595790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.595861] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.596566] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.596669] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.596732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.596878] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.596953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.597090] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.597181] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.597239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.597372] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.597439] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.598123] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.598232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.598298] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.598444] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.598517] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.598652] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.598730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.598917] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.599010] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.599070] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.599208] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.599279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.599411] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.599524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.599610] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.599798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.599877] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.600664] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.600774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.600841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.601008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.601087] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.601225] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.601316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.601375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.601513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.601584] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.602285] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.602390] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.602456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.602602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.602677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.602839] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.602935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.602998] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.603136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.603204] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.603880] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.603992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.604069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.604215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.604287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.604423] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.604513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.604572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.604707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.604777] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.605462] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.605570] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.605635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.605786] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.605859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.606002] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.606100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.606160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.606299] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.606370] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.607128] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.607238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.607305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.607453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.607530] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.607666] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.607757] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.607816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.607952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.608032] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.608798] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.608908] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.608972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.609118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.609192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.609327] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.609514] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.609600] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.609746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.609815] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.624159] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.624274] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.624342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.624499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.624582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.624749] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.624842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.624903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.625044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.625118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.625203] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 916dc4e3-1bc8-4ba5-b319-d9d0dee54564 is going to be deleted. [ 1483.642483] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.642629] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.642973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.642973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.642973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.643144] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.643242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.643306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.643460] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.643538] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.643626] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9efe5fcd-faf9-44dd-ac10-abd106d2dc72 is going to be deleted. [ 1483.668380] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.668524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.668589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.668798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.679207] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.679340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.679455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.679610] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.679697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.679795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9efe5fcd-faf9-44dd-ac10-abd106d2dc72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.680588] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.680689] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.680755] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.680935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.681015] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.681100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-916dc4e3-1bc8-4ba5-b319-d9d0dee54564" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.683670] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 151de087-3a41-4b53-b6d8-acc5a00d9c10 with status ACTIVE [ 1483.683799] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.684101] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.684101] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.684185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.684185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.684350] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.684438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.684497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.684631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.684746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.685967] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.686070] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.686138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.686283] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.686360] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.686511] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.686591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.687171] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.688972] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.689087] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.690236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.690346] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d193cbd-452d-400d-b88e-58fc27978848 is going to be deleted. [ 1483.691477] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.691652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.691767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.691912] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.692054] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.692123] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.692274] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.692352] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.692437] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5573ccf-d866-40ac-9bb4-1fa04e91ef9c is going to be deleted. [ 1483.706786] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.706916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.706979] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.707166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.707252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.707404] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.707498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.707560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.707703] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.707841] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.707934] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.707995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.708147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.708224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.708305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.708392] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.719048] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.719165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.719236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.719426] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.719510] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.719598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5573ccf-d866-40ac-9bb4-1fa04e91ef9c" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.722398] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e with status ACTIVE [ 1483.722564] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.722668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.722731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.722890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.722966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.723123] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.723214] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.723264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.723398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.723470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.727589] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.727589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.727732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.727778] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.727842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.728071] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.728162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.728162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.728307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.728441] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.728528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.728584] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.728715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.728858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.728949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.729031] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.743515] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.743698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.743767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.743973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.744062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.744421] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.744526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.744583] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.744737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.744879] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.745315] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.745383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.745522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.745599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.745682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.745830] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.745926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.745982] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.746115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.746184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.746319] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.746401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.746457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.746585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.746711] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.746794] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.746850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.746976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.747045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.747120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.747198] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.748041] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.748146] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.748210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.748355] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.748428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.748565] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.748652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.748709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.748841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.748981] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.749066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.749121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.749249] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.749317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.749391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.749468] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.751993] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.751993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.752132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.752219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.752294] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.752439] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.752532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.752595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.752738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.752874] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.752987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.753047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.753239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.753335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.753421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.753609] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.753657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.753707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.753841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.753914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.754072] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.754131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.754182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.754311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.754443] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.754531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.754589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.754722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.754797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.754875] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.754961] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.755717] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.755823] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.755891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.756055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.756132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.756271] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.756364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.756424] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.756561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.756690] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.756795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.756836] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.756955] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.757024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.757115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.757169] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.757812] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.758466] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.758574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.758657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.758786] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.758863] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.759005] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.759099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.759160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.759298] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.759429] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.759520] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.759606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.759713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.759787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.759869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.759950] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.761388] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.761496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.761563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.761711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.765362] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.765460] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.766374] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.766486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.766553] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.766711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.766789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.766935] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.767028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.767111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.767315] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.767518] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.767624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.767686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.767827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.767904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.767984] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.768092] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.774525] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.774661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.774732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.774931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.775020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.775114] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b is going to be updated. [ 1483.779306] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbf8f627-b3e9-41d3-bf72-822741bb5374: rpc.has_security_group_logging(os_id): False [ 1483.783644] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.783774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.783842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.784055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.784137] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.784289] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.784378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.784438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.784606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.785218] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.785313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.785379] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.785525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.785604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.785684] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.785832] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.785929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.785986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.786121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.786188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.786321] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.786406] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.786461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.786590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.786717] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.786801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.786856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.787009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.787090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.787168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.787251] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.790559] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.790619] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.790657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.790789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.790896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.791062] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.791154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.791209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.791348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.791478] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.791565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.791622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.791753] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.791825] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.791903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.792087] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.792176] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.792234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.792366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.792434] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.792566] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.792651] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.792707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.792837] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.792964] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.793047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.793100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.793229] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.793299] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.793374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.793459] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.795196] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d704867-786c-4653-bb82-7432f6f5dc3d with status ACTIVE [ 1483.795361] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.795462] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.795526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.795676] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.795754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.795990] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.796077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.796115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.796271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.796344] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.797459] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.797560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.797665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.797772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.797848] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.797995] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.798092] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.798157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.798297] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.798434] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.798526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.798585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.798721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.798819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.798931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.799019] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.799808] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1620446-f273-4658-baad-13a497dabc74: rpc.has_security_group_logging(os_id): False [ 1483.800759] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.801570] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.801680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.801748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.801902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.801986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.802130] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.802221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.802282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.802420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.802552] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.802642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.802702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.802835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.802910] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.802993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.803136] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.803220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.803272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.803408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.803478] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.803613] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.803702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.803761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.803894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.804056] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.804150] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.804208] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.804342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.804958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.804958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.804958] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.807030] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.807162] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 is going to be deleted. [ 1483.812733] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.812857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.812902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.813082] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.814169] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.814957] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ffcb57e-8678-415b-bd13-19b60dbd45bd: rpc.has_security_group_logging(os_id): False [ 1483.815936] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a2644aa-f99a-4b14-9145-702ba5c8452b: rpc.has_security_group_logging(os_id): False [ 1483.820183] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5233168b-5f93-4bb0-bac2-dd279d965d46: rpc.has_security_group_logging(os_id): False [ 1483.822364] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f129921-ca53-4911-9bcc-7d661d45384d: rpc.has_security_group_logging(os_id): False [ 1483.827158] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e583f7e5-364a-4a33-9784-9c313528bb3d: rpc.has_security_group_logging(os_id): False [ 1483.848091] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.848229] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.848289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.848507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.848657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.864941] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.865335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.873004] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b in Status: IN_PROGRESS for 2s [ 1483.893777] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.893926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.897056] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.897166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.903913] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.904054] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.908455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.908576] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 is going to be deleted. [ 1483.909986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.910200] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.910294] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.910420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.910576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.910742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.931462] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.931678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.933576] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.933727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.935501] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.935598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.943127] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.943334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.953261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.953567] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.953702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.953748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.953971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.954052] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.954261] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.954360] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.954422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.954576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.954651] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.954836] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.954923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.954983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.955124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.955197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.955293] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 is going to be updated. [ 1483.956527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.956696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.985185] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.985321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.986356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.986609] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.986724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.986794] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.987014] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.987114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.987319] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.987513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.987513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.987636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.987711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.987886] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.987971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1483.988060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.988215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1483.988296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1483.988391] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1483.989687] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1483.989854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.072414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.072694] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.072818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.072861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.073067] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.073153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.073420] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.073535] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.073598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.073754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.073830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.074028] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.074115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.074174] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.074315] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.074401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.074481] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1484.075657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.075823] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.130179] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.130409] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.142345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.144039] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.144039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.144039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.144039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.144039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.144039] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f129921-ca53-4911-9bcc-7d661d45384d is going to be updated. [ 1484.144559] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.144770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.155160] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.155280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.228177] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.228420] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.228613] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.228704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.229016] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.229168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.229486] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.229662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.229792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.230048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.230205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.230510] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.230672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.230792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.231049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.231169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.231338] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1620446-f273-4658-baad-13a497dabc74 is going to be updated. [ 1484.233005] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.233296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.233468] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.233674] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.233905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.234154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.318250] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.318449] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a is going to be deleted. [ 1484.319482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.319742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.319836] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.319993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.320207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.320405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.367032] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.367185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.418542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.419023] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.419188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.419296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.419544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.419681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.419820] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e583f7e5-364a-4a33-9784-9c313528bb3d is going to be updated. [ 1484.421140] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.421375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.421573] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.422789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.422972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.438413] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1484.438726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.438987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.439281] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.439422] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.453342] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.453672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.453845] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.454158] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.454406] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.454752] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.454963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.455055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.455280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.455486] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.455642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.455743] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.455936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.456104] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.456232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.456364] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.465824] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.465998] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.466112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.466356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.466492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.466708] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.466885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.466993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.467226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.467424] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.467580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.467680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.467864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.467993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.468221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.468659] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.468909] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.469048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.469344] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.469485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.469690] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.469847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.469954] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.470149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.470347] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.470494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.470596] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.470796] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.471084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.471221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.471357] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.479460] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0: rpc.has_security_group_logging(os_id): False [ 1484.497153] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.497476] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.506893] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.507127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.514272] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1484.565411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.565810] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.566002] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.566118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.566371] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.566507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.566760] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.566919] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.567035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.567233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.567359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.567592] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.567723] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.567822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.568016] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.568186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.568330] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be updated. [ 1484.569545] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.569774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.569971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.571071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.571320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.571509] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.574010] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.574173] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.574283] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.574605] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.574789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.575833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.576084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.576269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.581858] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.582109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.582233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.582519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.617100] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f129921-ca53-4911-9bcc-7d661d45384d in Status: IN_PROGRESS for 2s [ 1484.620215] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.620431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.625932] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 in Status: IN_PROGRESS for 2s [ 1484.626696] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1484.627338] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1620446-f273-4658-baad-13a497dabc74 in Status: IN_PROGRESS for 2s [ 1484.653249] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.653662] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.653874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.653989] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.654246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.654384] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.654654] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.654814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.654919] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.655125] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.655269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.655608] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.655750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.655853] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.656065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.656198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.656325] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 1484.657542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.657766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.657898] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.658075] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.708100] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.708258] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.708329] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.708705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.708909] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.770070] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.770303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.770303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.770481] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.770646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.775035] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e583f7e5-364a-4a33-9784-9c313528bb3d in Status: IN_PROGRESS for 2s [ 1484.826888] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 1484.836045] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1484.836608] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.836740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1484.836810] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1484.837023] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1484.837179] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1484.890941] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1485.774494] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1485.775053] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.775185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.775336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.775614] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.775714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.775814] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 151de087-3a41-4b53-b6d8-acc5a00d9c10 is going to be updated. [ 1485.779312] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.779448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.779494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.779674] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.779754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.779839] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e is going to be updated. [ 1485.797376] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.797536] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.797590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.797797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.797941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.798101] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-151de087-3a41-4b53-b6d8-acc5a00d9c10" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.798792] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1485.799275] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.799407] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.799479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.799680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.799816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.799972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7f28a4a-d2e3-4b3e-9c7d-d7ceaf846b2e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.806624] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1485.807184] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.807377] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.807377] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.807558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.807656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.807745] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d704867-786c-4653-bb82-7432f6f5dc3d is going to be updated. [ 1485.828330] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.828469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.828527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.828715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.828878] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.829037] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d704867-786c-4653-bb82-7432f6f5dc3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.883824] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b in Status: SUCCESS [ 1485.884063] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.884238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.884463] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.884656] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.884778] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.884843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.885002] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.885086] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.885172] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.885264] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.895163] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.895448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.895448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.895622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.895658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.895800] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.895899] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.895965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.896133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.896276] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.896371] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.896433] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.896572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.896654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.896736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.896880] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.896986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.897023] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.897156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.897228] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.897513] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.897611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.897673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.897815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.897947] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.898038] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.898097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.899334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.899414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.899498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.899594] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.907151] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b: rpc.has_security_group_logging(os_id): False [ 1485.951891] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.952361] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1485.952531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1485.952853] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1485.999272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1485.999828] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.000116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1486.000278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1486.000571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1486.000754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1486.001106] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.001332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1486.001485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1486.001775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1486.001956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1486.002284] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.002501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1486.002653] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1486.002915] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1486.003088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1486.003271] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b is going to be updated. [ 1486.072875] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.073096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1486.073202] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1486.073443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1486.073639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1486.087921] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b in Status: IN_PROGRESS for 2s [ 1486.527167] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1486.527418] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1486.630792] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f129921-ca53-4911-9bcc-7d661d45384d in Status: SUCCESS [ 1486.631066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1486.643383] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1620446-f273-4658-baad-13a497dabc74 in Status: SUCCESS [ 1486.643749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1486.644400] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1486.644565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1486.645218] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 in Status: SUCCESS [ 1486.645391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1486.786014] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e583f7e5-364a-4a33-9784-9c313528bb3d in Status: SUCCESS [ 1486.786242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1486.840426] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 1486.840664] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1486.904654] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1486.904952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1488.100137] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b in Status: SUCCESS [ 1488.100561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1488.574928] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1488.575103] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1493.575591] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1493.575938] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1498.577132] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1498.577516] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1503.579017] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1503.579369] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1508.580419] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1508.580689] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1513.582147] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1513.582464] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1518.584020] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1518.584408] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1523.585560] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1523.585848] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1526.864373] env[61817]: INFO networking_nsxv3.common.synchronization [req-56c681d0-adc0-46c1-88a4-803b466c34e0 req-e2c89ba2-5b39-4311-a280-9c16ccf801e5 tempest-InstanceActionsV221TestJSON-1625642940 tempest-InstanceActionsV221TestJSON-1625642940-project-member] Enqueued Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGHEST for action security_group_members [ 1526.865097] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGHEST for action security_group_members [ 1526.865097] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.865097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1526.865238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1526.865342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1526.865582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1526.865582] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.865697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1526.865742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1526.865871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1526.866005] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.866096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1526.866156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1526.866484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1526.866484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1526.866484] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1526.875301] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.875448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1526.875499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1526.875663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1526.875751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1526.875925] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.876034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1526.876099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1526.876246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1526.876323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1526.876411] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b is going to be updated. [ 1526.922124] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.922124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1526.922124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1526.922124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1526.922124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1526.933273] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b in Status: IN_PROGRESS for 2s [ 1528.046750] env[61817]: INFO networking_nsxv3.common.synchronization [req-aeb1acbf-26da-4ebc-9565-e513c4168e3e req-b1e1e6a2-e91e-4a06-9bfe-b42a8321142a tempest-ServerRescueNegativeTestJSON-901351471 tempest-ServerRescueNegativeTestJSON-901351471-project-member] Enqueued Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGHEST for action security_group_members [ 1528.046750] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGHEST for action security_group_members [ 1528.046750] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.046750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.046750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.046750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.046750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.046750] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.046750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.046750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.046750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.046750] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.046750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.046750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.046750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.046750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.046750] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1528.056454] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.056454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.056454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.056454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.056454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.056454] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.056454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.056454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.056454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.056454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.056454] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 already deleted. [ 1528.056454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.612820] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.612820] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.612938] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.613165] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.613317] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.613568] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-427 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.613726] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-427" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.613846] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-427" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.614138] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-427" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.614396] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.614554] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.614672] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.614888] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.615034] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.615184] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-427" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.615433] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.615607] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.615741] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.615953] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.616105] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.616392] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-dc289594-c992-4a94-b2b5-70c35f8bc2bb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.616553] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-dc289594-c992-4a94-b2b5-70c35f8bc2bb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.616681] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-dc289594-c992-4a94-b2b5-70c35f8bc2bb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.616916] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-dc289594-c992-4a94-b2b5-70c35f8bc2bb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.617079] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc289594-c992-4a94-b2b5-70c35f8bc2bb',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1528.634460] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.634666] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.634820] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.635108] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.635264] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.635417] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port dc289594-c992-4a94-b2b5-70c35f8bc2bb not found, creating... [ 1528.635705] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.635862] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.635975] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.636209] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.636352] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.636632] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.636786] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.636904] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.637110] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.637294] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.637470] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: dc289594-c992-4a94-b2b5-70c35f8bc2bb is going to be created. [ 1528.659263] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.659475] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1528.659593] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1528.660084] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1528.660138] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.660756] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-dc289594-c992-4a94-b2b5-70c35f8bc2bb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1528.944263] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b in Status: SUCCESS [ 1528.944455] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b deletion is rescheduled due to dependency. [ 1528.944576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1529.276155] env[61817]: INFO networking_nsxv3.common.synchronization [req-aeb1acbf-26da-4ebc-9565-e513c4168e3e req-01ebdfdb-af11-4c73-aec3-3c80d90c5105 service neutron] Enqueued Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGHEST for action security_group_rules [ 1529.276450] env[61817]: INFO networking_nsxv3.common.synchronization [req-aeb1acbf-26da-4ebc-9565-e513c4168e3e req-01ebdfdb-af11-4c73-aec3-3c80d90c5105 service neutron] Enqueued Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGHEST for action security_group_members [ 1529.276490] env[61817]: INFO networking_nsxv3.common.synchronization [req-aeb1acbf-26da-4ebc-9565-e513c4168e3e req-01ebdfdb-af11-4c73-aec3-3c80d90c5105 service neutron] Enqueued Resource ID: dc289594-c992-4a94-b2b5-70c35f8bc2bb with Priority: HIGHEST for action port [ 1529.277081] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGHEST for action security_group_rules [ 1529.277203] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGHEST for action security_group_members [ 1529.277350] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc289594-c992-4a94-b2b5-70c35f8bc2bb with Priority: HIGHEST for action port [ 1529.277642] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.277765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.277834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.278056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.278168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1529.278425] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.278564] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.278631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.278831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.278926] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.279772] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.279884] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.279953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.280452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.280452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1529.280452] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.280452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.280623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.280661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.280800] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.280941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.280990] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.281133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.281211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1529.281296] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.282346] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.282457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.282540] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.282695] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.282796] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1529.282944] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc289594-c992-4a94-b2b5-70c35f8bc2bb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.283040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc289594-c992-4a94-b2b5-70c35f8bc2bb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.283101] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc289594-c992-4a94-b2b5-70c35f8bc2bb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.283267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc289594-c992-4a94-b2b5-70c35f8bc2bb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.283338] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc289594-c992-4a94-b2b5-70c35f8bc2bb',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.302567] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.302706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.302770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.303026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.303134] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1529.303358] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.303429] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.303537] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.307450] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc289594-c992-4a94-b2b5-70c35f8bc2bb with status ACTIVE [ 1529.307708] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.307870] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.307978] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.308269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.308390] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1529.308595] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.308728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.308794] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.308958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.309036] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1529.313246] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.320739] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.320859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.320952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.321153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.321237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1529.321330] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 is going to be created. [ 1529.363915] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.364122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.364122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.364354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.364513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1529.374390] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 in Status: UNINITIALIZED for 2s [ 1529.673214] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.673375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.673445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.673650] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.673738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1529.673835] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc289594-c992-4a94-b2b5-70c35f8bc2bb is going to be updated. [ 1529.695729] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1529.695935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1529.695978] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1529.696213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1529.696358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1529.696522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc289594-c992-4a94-b2b5-70c35f8bc2bb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1530.073653] env[61817]: INFO networking_nsxv3.common.synchronization [None req-24e2f37d-6577-44f0-adb1-83058f1aec38 None None] Enqueued Resource ID: bce876a1-b3d1-43cb-9405-fe831e1ff189 with Priority: HIGHEST for action port [ 1530.074266] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bce876a1-b3d1-43cb-9405-fe831e1ff189 with Priority: HIGHEST for action port [ 1530.074596] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.074724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1530.074803] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1530.075702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1530.075702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1530.075702] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-bce876a1-b3d1-43cb-9405-fe831e1ff189 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.075702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bce876a1-b3d1-43cb-9405-fe831e1ff189" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1530.075702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bce876a1-b3d1-43cb-9405-fe831e1ff189" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1530.075702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bce876a1-b3d1-43cb-9405-fe831e1ff189" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1530.075702] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bce876a1-b3d1-43cb-9405-fe831e1ff189',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1530.085890] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bce876a1-b3d1-43cb-9405-fe831e1ff189 [ 1530.086106] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.086238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1530.086307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1530.086531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1530.086599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1530.086662] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bce876a1-b3d1-43cb-9405-fe831e1ff189 already deleted. [ 1530.086746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bce876a1-b3d1-43cb-9405-fe831e1ff189" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.386554] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 in Status: SUCCESS [ 1531.387021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.387021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.387214] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.387415] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.387604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1531.387604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.387749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.387843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.387927] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.388047] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.398570] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.398933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1531.398933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.399077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.399129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.399295] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.399401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1531.399656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.399656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.399736] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.400016] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1531.400118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.400585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.400709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.400789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.400969] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.401243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1531.401243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.401347] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.401421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.401626] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.401795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1531.402319] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.402319] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.402538] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.402538] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1531.402538] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.402983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.402983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.402983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.402983] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1531.419706] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ccdfdda-5544-48a2-976b-b365f092bbb9: rpc.has_security_group_logging(os_id): False [ 1531.441406] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.441609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1531.441656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.441831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.441947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.442349] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.442485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1531.442551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.442930] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.443068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.443336] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.443497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1531.443600] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.443898] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.444060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.444314] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.444503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1531.444780] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.444780] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.444912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.445024] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 is going to be created. [ 1531.511716] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1531.512122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1531.512299] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1531.512573] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1531.512829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1531.526541] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 in Status: IN_PROGRESS for 2s [ 1532.446727] env[61817]: INFO networking_nsxv3.common.synchronization [None req-1ab38cb4-f883-42c4-84bd-1c3c1db61821 None None] Enqueued Resource ID: 0532e098-e64e-4433-bd4c-8eabc4de79ed with Priority: HIGHEST for action port [ 1532.446727] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0532e098-e64e-4433-bd4c-8eabc4de79ed with Priority: HIGHEST for action port [ 1532.446727] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.446727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1532.446727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1532.446727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1532.446727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1532.446727] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-0532e098-e64e-4433-bd4c-8eabc4de79ed taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.446727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0532e098-e64e-4433-bd4c-8eabc4de79ed" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1532.446727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0532e098-e64e-4433-bd4c-8eabc4de79ed" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1532.446727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0532e098-e64e-4433-bd4c-8eabc4de79ed" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1532.446727] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0532e098-e64e-4433-bd4c-8eabc4de79ed',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1532.458305] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0532e098-e64e-4433-bd4c-8eabc4de79ed [ 1532.458698] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.458983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1532.459165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1532.459452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1532.459664] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1532.459912] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0532e098-e64e-4433-bd4c-8eabc4de79ed already deleted. [ 1532.460139] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0532e098-e64e-4433-bd4c-8eabc4de79ed" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1533.456385] env[61817]: INFO networking_nsxv3.common.synchronization [None req-d2f4f911-7689-474a-a24e-b1de6542b7d4 None None] Enqueued Resource ID: 765d9e50-cd76-4b35-b3e6-7b6a29cd405e with Priority: HIGHEST for action port [ 1533.456905] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 765d9e50-cd76-4b35-b3e6-7b6a29cd405e with Priority: HIGHEST for action port [ 1533.457244] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.457367] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1533.457438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1533.457635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1533.457717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1533.457862] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-765d9e50-cd76-4b35-b3e6-7b6a29cd405e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.457954] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-765d9e50-cd76-4b35-b3e6-7b6a29cd405e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1533.458018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-765d9e50-cd76-4b35-b3e6-7b6a29cd405e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1533.458208] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-765d9e50-cd76-4b35-b3e6-7b6a29cd405e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1533.458286] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('765d9e50-cd76-4b35-b3e6-7b6a29cd405e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.468753] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 765d9e50-cd76-4b35-b3e6-7b6a29cd405e [ 1533.469269] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.469398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1533.469463] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1533.469675] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1533.469725] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1533.469818] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:765d9e50-cd76-4b35-b3e6-7b6a29cd405e already deleted. [ 1533.469894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-765d9e50-cd76-4b35-b3e6-7b6a29cd405e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1533.539958] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 in Status: SUCCESS [ 1533.540251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1535.534975] env[61817]: INFO networking_nsxv3.common.synchronization [None req-5f073531-e751-4b75-bb91-267456e27e96 None None] Enqueued Resource ID: 7451b79e-4f1a-461d-be87-4848dec70524 with Priority: HIGHEST for action port [ 1535.535239] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7451b79e-4f1a-461d-be87-4848dec70524 with Priority: HIGHEST for action port [ 1535.535813] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.535945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1535.536026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1535.536229] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1535.536320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1535.536476] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-7451b79e-4f1a-461d-be87-4848dec70524 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.536576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7451b79e-4f1a-461d-be87-4848dec70524" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1535.536638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7451b79e-4f1a-461d-be87-4848dec70524" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1535.537190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7451b79e-4f1a-461d-be87-4848dec70524" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1535.537282] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7451b79e-4f1a-461d-be87-4848dec70524',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.552067] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7451b79e-4f1a-461d-be87-4848dec70524 [ 1535.552283] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.552404] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1535.552470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1535.552667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1535.552755] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1535.552846] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7451b79e-4f1a-461d-be87-4848dec70524 already deleted. [ 1535.552925] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7451b79e-4f1a-461d-be87-4848dec70524" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1535.596996] env[61817]: INFO networking_nsxv3.common.synchronization [None req-72b11c4a-751d-4ffe-bc90-d39428f5652a tempest-AttachSCSIVolumeTestJSON-274273257 tempest-AttachSCSIVolumeTestJSON-274273257-project-member] Enqueued Resource ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 with Priority: HIGHEST for action security_group_rules [ 1535.597544] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 with Priority: HIGHEST for action security_group_rules [ 1535.597842] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.597966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1535.598035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1535.598235] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1535.598318] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1535.598470] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.598567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1535.598628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1535.598828] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1535.598912] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.640452] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.640678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1535.640678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1535.641349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1535.641516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1535.641779] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 already deleted. [ 1535.641912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1535.690663] env[61817]: INFO networking_nsxv3.common.synchronization [None req-def4a5e8-9c18-42a0-a256-eb22a2e3c160 tempest-AttachSCSIVolumeTestJSON-274273257 tempest-AttachSCSIVolumeTestJSON-274273257-project-member] Enqueued Resource ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 with Priority: HIGHEST for action security_group_rules [ 1535.691176] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 with Priority: HIGHEST for action security_group_rules [ 1535.691499] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.692164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1535.692164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1535.692164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1535.692164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1535.692164] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.692446] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1535.692446] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1535.692525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1535.692560] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.736668] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.736668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1535.736668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1535.736668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1535.736668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1535.736668] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 already deleted. [ 1535.736668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1540.692451] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.692451] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1545.693985] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1545.694628] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1550.695793] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1550.695793] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1555.696494] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1555.696862] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1560.698119] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1560.698375] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1565.699146] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1565.699583] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1570.701244] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1570.701244] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1575.701764] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1575.702079] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1578.113778] env[61817]: INFO networking_nsxv3.common.synchronization [req-af3d0431-9866-493d-8f3d-8f42888a9169 req-2cd4a287-5533-4867-a4fd-c9c1c9f04ad7 tempest-ServerRescueTestJSONUnderV235-65706538 tempest-ServerRescueTestJSONUnderV235-65706538-project-member] Enqueued Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGHEST for action security_group_members [ 1578.114296] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGHEST for action security_group_members [ 1578.114608] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.114733] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1578.114802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1578.115005] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1578.115090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1578.115245] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.115345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1578.115405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1578.115552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1578.115685] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.115776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1578.116096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1578.116096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1578.116096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1578.116200] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.124840] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.124964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1578.125010] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1578.125141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1578.125228] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1578.125408] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.125504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1578.125566] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1578.125708] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1578.125785] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1578.125870] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 is going to be updated. [ 1578.163607] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.163730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1578.163801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1578.164031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1578.164186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1578.175140] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 in Status: IN_PROGRESS for 2s [ 1580.186123] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 in Status: SUCCESS [ 1580.186370] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 deletion is rescheduled due to dependency. [ 1580.186370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1583.115891] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1583.116183] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1583.712725] env[61817]: INFO networking_nsxv3.common.synchronization [None req-5a48d3e9-2312-4456-b823-a3add7207e93 None None] Enqueued Resource ID: f79d2ed8-06bb-446f-9a8d-6168617c6012 with Priority: HIGHEST for action port [ 1583.712974] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f79d2ed8-06bb-446f-9a8d-6168617c6012 with Priority: HIGHEST for action port [ 1583.713544] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.713666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1583.713736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1583.713941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1583.714023] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1583.714172] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f79d2ed8-06bb-446f-9a8d-6168617c6012 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.714257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f79d2ed8-06bb-446f-9a8d-6168617c6012" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1583.714320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f79d2ed8-06bb-446f-9a8d-6168617c6012" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1583.714518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f79d2ed8-06bb-446f-9a8d-6168617c6012" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1583.714618] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f79d2ed8-06bb-446f-9a8d-6168617c6012',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.734329] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f79d2ed8-06bb-446f-9a8d-6168617c6012 [ 1583.734532] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.734655] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1583.734716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1583.734907] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1583.734991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1583.735081] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f79d2ed8-06bb-446f-9a8d-6168617c6012 already deleted. [ 1583.735157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f79d2ed8-06bb-446f-9a8d-6168617c6012" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1585.777174] env[61817]: INFO networking_nsxv3.common.synchronization [None req-105da1aa-8455-4b93-8f17-b94ee7fe6fc2 None None] Enqueued Resource ID: de114425-1e57-492a-af42-afa56ced68eb with Priority: HIGHEST for action port [ 1585.777476] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de114425-1e57-492a-af42-afa56ced68eb with Priority: HIGHEST for action port [ 1585.778018] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.778130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1585.778198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1585.778391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1585.778469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1585.778623] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-de114425-1e57-492a-af42-afa56ced68eb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.778715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de114425-1e57-492a-af42-afa56ced68eb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1585.778771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de114425-1e57-492a-af42-afa56ced68eb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1585.778969] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de114425-1e57-492a-af42-afa56ced68eb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1585.779047] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de114425-1e57-492a-af42-afa56ced68eb',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.788620] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de114425-1e57-492a-af42-afa56ced68eb [ 1585.788805] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.788920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1585.788986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1585.789217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1585.789301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1585.789412] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de114425-1e57-492a-af42-afa56ced68eb already deleted. [ 1585.789488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de114425-1e57-492a-af42-afa56ced68eb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1590.779081] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1590.779402] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1595.780120] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1595.780558] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1600.782125] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1600.782450] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1605.783591] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1605.784141] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1610.785311] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1610.785643] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1615.786564] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1615.786980] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1620.788351] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1620.788621] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1625.789990] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1625.790422] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1627.543388] env[61817]: INFO networking_nsxv3.common.synchronization [req-040f08fb-5eec-460d-b38f-2501476783e1 req-b06d9ea7-ffdb-4ff3-ac02-3127723f8e8e tempest-ServerDiskConfigTestJSON-1489146392 tempest-ServerDiskConfigTestJSON-1489146392-project-member] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1627.543898] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1627.544214] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.544343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1627.544411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1627.544598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1627.544686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1627.544839] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.544927] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1627.544990] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1627.545131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1627.545266] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.545356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1627.545416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1627.545566] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1627.545643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1627.545742] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1627.560040] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.560200] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1627.560200] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1627.560367] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1627.560457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1627.560640] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.560738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1627.560800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1627.560963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1627.561049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1627.561136] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1627.595434] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1627.595610] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1627.595678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1627.595838] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1627.595978] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1627.611313] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1628.766128] env[61817]: INFO networking_nsxv3.common.synchronization [req-db473365-0f04-40ef-aaa0-66e555ff696f req-26f47bc6-c3fd-41e3-bb78-4a9dcba8902b tempest-MultipleCreateTestJSON-1001388970 tempest-MultipleCreateTestJSON-1001388970-project-member] Enqueued Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGHEST for action security_group_members [ 1628.766721] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGHEST for action security_group_members [ 1628.767066] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.767200] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1628.767269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1628.767484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1628.767570] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1628.767754] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.767881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1628.767941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1628.768170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1628.768315] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.768406] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1628.768489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1628.768637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1628.768717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1628.768805] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1628.780033] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.780179] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1628.780238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1628.780423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1628.780502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1628.780749] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.780817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1628.780817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1628.781960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1628.781960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1628.781960] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 already deleted. [ 1628.781960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.073550] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.073735] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.073862] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.074155] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.074280] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.074539] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-753 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.074692] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-753" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.074812] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-753" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.075079] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-753" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.075324] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.075481] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.075600] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.075886] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.076064] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.076224] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-753" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.076477] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.076632] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.076764] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.076978] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.077113] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.077348] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-6d47af2d-c7a5-4708-ace3-8c311664b936 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.077528] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-6d47af2d-c7a5-4708-ace3-8c311664b936" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.077620] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-6d47af2d-c7a5-4708-ace3-8c311664b936" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.077861] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-6d47af2d-c7a5-4708-ace3-8c311664b936" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.078003] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d47af2d-c7a5-4708-ace3-8c311664b936',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.092965] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.093149] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.093276] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.093531] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.093677] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.093826] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 6d47af2d-c7a5-4708-ace3-8c311664b936 not found, creating... [ 1629.094069] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.094225] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.094342] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.094558] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.094692] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.094975] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.095128] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.095244] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.095449] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.095580] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.095718] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 6d47af2d-c7a5-4708-ace3-8c311664b936 is going to be created. [ 1629.120863] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.121212] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.121373] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.121623] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.121862] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.122179] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-6d47af2d-c7a5-4708-ace3-8c311664b936" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.403121] env[61817]: INFO networking_nsxv3.common.synchronization [req-db473365-0f04-40ef-aaa0-66e555ff696f req-d6b2a9e3-3942-49e3-a00c-db6dc2ede8ab service neutron] Enqueued Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGHEST for action security_group_rules [ 1629.403354] env[61817]: INFO networking_nsxv3.common.synchronization [req-db473365-0f04-40ef-aaa0-66e555ff696f req-d6b2a9e3-3942-49e3-a00c-db6dc2ede8ab service neutron] Enqueued Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGHEST for action security_group_members [ 1629.403503] env[61817]: INFO networking_nsxv3.common.synchronization [req-db473365-0f04-40ef-aaa0-66e555ff696f req-d6b2a9e3-3942-49e3-a00c-db6dc2ede8ab service neutron] Enqueued Resource ID: 6d47af2d-c7a5-4708-ace3-8c311664b936 with Priority: HIGHEST for action port [ 1629.403734] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGHEST for action security_group_rules [ 1629.403859] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGHEST for action security_group_members [ 1629.403956] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d47af2d-c7a5-4708-ace3-8c311664b936 with Priority: HIGHEST for action port [ 1629.404896] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.405028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.405100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.405296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.405382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.405537] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.405632] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.405695] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.405889] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.405971] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.406842] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.406952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.407012] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.407163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.407235] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.407375] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.407464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.407747] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.407747] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.407816] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.407864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.407924] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.408090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.408233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.408312] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.409070] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.409170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.409236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.411789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.411876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.412083] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d47af2d-c7a5-4708-ace3-8c311664b936 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.412191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d47af2d-c7a5-4708-ace3-8c311664b936" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.412359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d47af2d-c7a5-4708-ace3-8c311664b936" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.412526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d47af2d-c7a5-4708-ace3-8c311664b936" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.412603] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d47af2d-c7a5-4708-ace3-8c311664b936',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.421622] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.461279] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.463469] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.463643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.463690] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.463879] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.463970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.464273] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.464273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.469737] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d47af2d-c7a5-4708-ace3-8c311664b936 with status ACTIVE [ 1629.469921] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.470040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.470110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.470314] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.470397] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.470563] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.470663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.470716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.470861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.470946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.474484] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.474484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.474484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.474707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.474707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.474779] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 is going to be created. [ 1629.515398] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.515398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.515398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.515398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.515398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.524664] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 in Status: UNINITIALIZED for 2s [ 1629.622258] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1629.622258] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 deletion is rescheduled due to dependency. [ 1629.622258] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.833673] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.834048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.834048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.834222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.834268] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.834348] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d47af2d-c7a5-4708-ace3-8c311664b936 is going to be updated. [ 1629.855745] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.856089] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1629.856212] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1629.856448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1629.856621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1629.856820] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d47af2d-c7a5-4708-ace3-8c311664b936" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.535327] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 in Status: SUCCESS [ 1631.535717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.535717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.535853] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.536056] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.536184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1631.536249] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.536439] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.536523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.536609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.536700] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1631.546112] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.546239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1631.546303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.546472] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.546554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.546708] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.546797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1631.546863] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.547008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.547146] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.547240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1631.547302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.547439] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.547666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.547783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.548116] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.548217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1631.548280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.548427] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.548503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.548643] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.548736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1631.548796] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.548982] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.549133] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.549307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1631.549374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.549518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.549593] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.549675] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.549762] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1631.555752] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 809c9d4c-eb3e-493d-bbfc-45d99fd37e44: rpc.has_security_group_logging(os_id): False [ 1631.576610] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.576767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1631.576818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.577003] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.577082] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.577297] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.577396] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1631.577444] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.577589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.577665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.577884] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.577986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1631.578047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.578341] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.578423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.578613] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.578787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1631.578787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.578915] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.578988] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.579072] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 is going to be created. [ 1631.641422] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.641664] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1631.641664] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1631.641841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1631.642091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1631.654206] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 in Status: IN_PROGRESS for 2s [ 1633.668042] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 in Status: SUCCESS [ 1633.668431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1634.404513] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1634.404718] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1639.405734] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1639.406063] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1644.406913] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1644.407391] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1649.408394] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1649.408799] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1654.410002] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1654.410335] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1659.411292] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1659.411723] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1664.412426] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1664.412769] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1669.413887] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1669.414191] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1674.415154] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1674.415553] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1678.306757] env[61817]: INFO networking_nsxv3.common.synchronization [req-03fb4196-531f-46be-b2ef-f094465577c5 req-2b33e886-1351-4d77-9dd6-e63690ba4b4d tempest-ServersTestJSON-1722207346 tempest-ServersTestJSON-1722207346-project-member] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1678.308047] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1678.308047] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.308047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1678.308047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1678.308047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1678.308047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1678.308431] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.308431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1678.308431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1678.308578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1678.308612] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.308816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1678.308816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1678.308898] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1678.308931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1678.309030] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1678.321207] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.321332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1678.321525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1678.321605] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1678.321674] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1678.321847] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.321959] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1678.322024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1678.322186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1678.322262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1678.322346] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be updated. [ 1678.354507] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1678.354507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1678.354507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1678.354822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1678.354912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1678.365357] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 1679.490148] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f8ac291-6e64-45d3-8422-b24e8b422c0d req-9169a18e-f334-4a0c-ba86-48d3d227d173 tempest-AttachSCSIVolumeTestJSON-274273257 tempest-AttachSCSIVolumeTestJSON-274273257-project-member] Enqueued Resource ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 with Priority: HIGHEST for action security_group_members [ 1679.490735] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 with Priority: HIGHEST for action security_group_members [ 1679.491164] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.491287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.491354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.491554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.491637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.491789] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.491884] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.492024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.492226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.492369] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.492591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.492591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.492697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.492775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.492866] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1679.506312] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.506312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.506312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.506470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.506470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.506634] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.506724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.506779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.506917] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.506987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.507065] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 already deleted. [ 1679.507138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.777941] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.778168] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.778303] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.778575] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.778719] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.779015] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-873 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.779194] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-873" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.779304] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-873" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.779577] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-873" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.779825] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.779980] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.780115] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.780328] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.780466] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.780729] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 871 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.780880] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.781042] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.781260] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.781398] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.781539] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: Segment with ID: nsx-vlan-transportzone-873 is going to be created. [ 1679.807773] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 871 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.807920] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.808066] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.808734] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.809003] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.809296] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-873" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.809630] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.809854] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.810031] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.810318] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.810496] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.810785] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.810997] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.811135] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.811409] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.811549] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1679.826409] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.826602] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.826731] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.826982] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.827134] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.827286] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d not found, creating... [ 1679.827538] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.827696] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.827815] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.828051] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.828202] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.828487] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.828651] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.828772] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.829076] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.829226] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.829372] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d is going to be created. [ 1679.862906] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1679.863178] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1679.863313] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1679.863605] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1679.863846] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1679.864085] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.089217] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f8ac291-6e64-45d3-8422-b24e8b422c0d req-78fb7010-183f-4750-9592-7f553cdbbf6d service neutron] Enqueued Resource ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 with Priority: HIGHEST for action security_group_rules [ 1680.089475] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f8ac291-6e64-45d3-8422-b24e8b422c0d req-78fb7010-183f-4750-9592-7f553cdbbf6d service neutron] Enqueued Resource ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 with Priority: HIGHEST for action security_group_members [ 1680.089604] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f8ac291-6e64-45d3-8422-b24e8b422c0d req-78fb7010-183f-4750-9592-7f553cdbbf6d service neutron] Enqueued Resource ID: 8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d with Priority: HIGHEST for action port [ 1680.089842] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 with Priority: HIGHEST for action security_group_rules [ 1680.089973] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 with Priority: HIGHEST for action security_group_members [ 1680.090076] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d with Priority: HIGHEST for action port [ 1680.090656] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.090791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.090873] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.091144] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.091243] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.091405] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.091506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.091571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.091732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.091814] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1680.092746] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.092829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.092893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.093077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.093121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.093541] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.093655] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.093721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.093879] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.094025] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.094248] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.094321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.094527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.094622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.094715] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1680.096065] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.096230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.096325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.096531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.096642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.096818] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.096948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.097046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.097219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.097346] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1680.119760] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1680.121715] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d with status ACTIVE [ 1680.122008] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.122301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.122411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.122660] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.122781] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.123097] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.123276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.123374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.123569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.123673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.124978] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.125119] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.125239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.125420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.126026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.126279] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.126421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.132346] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1680.141054] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.141304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.141398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.141632] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.141748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.141884] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 is going to be created. [ 1680.384066] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 1680.384307] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd deletion is rescheduled due to dependency. [ 1680.384446] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.592170] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.592575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.592575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.592664] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.592703] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.592788] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d is going to be updated. [ 1680.613887] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1680.614061] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1680.614109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1680.614295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1680.614435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.614782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a4e2ad6-7678-4e9e-a7af-1edaf4213a4d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1680.623175] env[61817]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9', 'data': {'id': '0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9', 'display_name': '0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9', 'path': '/infra/domains/default/groups/0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9', 'expression': [{'value': 'security_group|0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}, {'resource_type': 'ConjunctionOperator', 'conjunction_operator': 'OR'}, {'resource_type': 'IPAddressExpression', 'ip_addresses': ['10.0.0.4']}], 'tags': [{'scope': 'age', 'tag': 1707829409}, {'scope': 'revision_number', 'tag': 0}], '_revision': None}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1680.623329] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.put {{(pid=61817) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}} [ 1682.661450] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1682.661900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1682.661900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1682.661900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1682.662063] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1682.672565] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 in Status: UNINITIALIZED for 2s [ 1684.544643] env[61817]: INFO networking_nsxv3.common.synchronization [req-6f8ac291-6e64-45d3-8422-b24e8b422c0d req-e629bb2c-9410-431f-9853-34f1f317dcd3 tempest-AttachSCSIVolumeTestJSON-274273257 tempest-AttachSCSIVolumeTestJSON-274273257-project-member] Enqueued Resource ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 with Priority: HIGHEST for action security_group_members [ 1684.545099] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 with Priority: HIGHEST for action security_group_members [ 1684.545245] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.545394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1684.545493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.545923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.545923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.546053] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.546276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1684.684551] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 in Status: SUCCESS [ 1684.684727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.684887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.685099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.685288] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.685409] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1684.685487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.685624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.685705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.685789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.685885] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1684.686735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.686913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.687052] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.687157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1684.687223] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.687365] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.687443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.687527] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1684.701178] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.701389] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1684.701389] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.701622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.701718] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.702029] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.702210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1684.702301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.702481] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.702564] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.702664] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 is going to be deleted. [ 1684.704361] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1684.710833] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9: rpc.has_security_group_logging(os_id): False [ 1684.731279] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.731451] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1684.731496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.731998] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.731998] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.732158] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.732158] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1684.732249] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.732334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.732432] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.732524] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 is going to be created. [ 1684.743761] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.743960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1684.743960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.744166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.744253] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.744345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.759272] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9], does not exist path=[/infra/domains/default/groups/0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9]."\n}' [ 1684.759519] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 [ 1684.759640] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1684.792023] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 40 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.792262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1684.792393] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.792641] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.793302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.793610] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 43 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.793729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1684.793773] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.793940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.794023] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.794236] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 44 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1684.794350] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1684.794393] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1684.794531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1684.794606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.794691] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 is going to be created. [ 1684.834934] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9], does not exist path=[/infra/domains/default/groups/0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 [ 1684.835207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1684.835597] env[61817]: Traceback (most recent call last): [ 1684.835666] env[61817]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 35, in wrapper [ 1684.835666] env[61817]: return func(*args, **kwargs) [ 1684.835666] env[61817]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 659, in _realize [ 1684.835666] env[61817]: res.raise_for_status() [ 1684.835666] env[61817]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1021, in raise_for_status [ 1684.835666] env[61817]: raise HTTPError(http_error_msg, response=self) [ 1684.835666] env[61817]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 [ 1684.835666] env[61817]: During handling of the above exception, another exception occurred: [ 1684.835666] env[61817]: Traceback (most recent call last): [ 1684.835666] env[61817]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1684.835666] env[61817]: listener.cb(fileno) [ 1684.835666] env[61817]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 264, in main [ 1684.835666] env[61817]: result = function(*args, **kwargs) [ 1684.835666] env[61817]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 254, in security_group_rules [ 1684.835666] env[61817]: self.plcy_provider.sg_rules_realize(os_sg, logged=logged) [ 1684.835666] env[61817]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 890, in sg_rules_realize [ 1684.835666] env[61817]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1684.835666] env[61817]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 44, in wrapper [ 1684.835666] env[61817]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1684.835666] env[61817]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 659, in _realize [ 1684.835666] env[61817]: res.raise_for_status() [ 1684.835666] env[61817]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1021, in raise_for_status [ 1684.835666] env[61817]: raise HTTPError(http_error_msg, response=self) [ 1684.835666] env[61817]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0317e8e7-dcca-4b3c-ba50-e4fb7f201cc9 [ 1684.835666] env[61817]: Removing descriptor: 16 [ 1685.488702] env[61817]: INFO networking_nsxv3.common.synchronization [req-f78e0d9f-7c95-445e-a5af-94c1d1276ed1 req-46b01c78-3437-4239-a5ac-a339e15066e2 tempest-ServersNegativeTestJSON-1897410890 tempest-ServersNegativeTestJSON-1897410890-project-member] Enqueued Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGHEST for action security_group_members [ 1685.489212] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGHEST for action security_group_members [ 1685.489529] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.489656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.489749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.489913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.490000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.490155] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.490246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.490307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.490486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.490624] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.490713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.490772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.490905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.491015] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.491105] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1685.504345] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.504345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.504345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.504345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.504345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.504345] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.504345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.504345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.504345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.504345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.504345] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 already deleted. [ 1685.504345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.767126] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.767479] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.767479] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.767693] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.767977] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.768110] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-976 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.768288] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-976" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.768407] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-976" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.768678] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-976" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.769287] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.769460] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.769586] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.769800] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.769960] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.770098] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-976" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.770347] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.770501] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.770618] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.770826] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.771026] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.771242] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-8778757e-fca1-410f-8a35-ca0c49b2d8f0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.771402] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-8778757e-fca1-410f-8a35-ca0c49b2d8f0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.771515] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-8778757e-fca1-410f-8a35-ca0c49b2d8f0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.771763] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-8778757e-fca1-410f-8a35-ca0c49b2d8f0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.771901] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8778757e-fca1-410f-8a35-ca0c49b2d8f0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1685.786828] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.787065] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.787157] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.787548] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.787681] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.787767] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 8778757e-fca1-410f-8a35-ca0c49b2d8f0 not found, creating... [ 1685.788207] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.788607] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.788607] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.789399] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.789399] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.789399] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.789551] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.789587] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.789795] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.789940] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.790089] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 8778757e-fca1-410f-8a35-ca0c49b2d8f0 is going to be created. [ 1685.821735] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1685.821983] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1685.822385] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1685.822440] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1685.822642] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1685.822873] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-8778757e-fca1-410f-8a35-ca0c49b2d8f0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1686.042948] env[61817]: INFO networking_nsxv3.common.synchronization [req-f78e0d9f-7c95-445e-a5af-94c1d1276ed1 req-99935d65-da77-4c34-86de-035f373db451 service neutron] Enqueued Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGHEST for action security_group_rules [ 1686.043138] env[61817]: INFO networking_nsxv3.common.synchronization [req-f78e0d9f-7c95-445e-a5af-94c1d1276ed1 req-99935d65-da77-4c34-86de-035f373db451 service neutron] Enqueued Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGHEST for action security_group_members [ 1686.043287] env[61817]: INFO networking_nsxv3.common.synchronization [req-f78e0d9f-7c95-445e-a5af-94c1d1276ed1 req-99935d65-da77-4c34-86de-035f373db451 service neutron] Enqueued Resource ID: 8778757e-fca1-410f-8a35-ca0c49b2d8f0 with Priority: HIGHEST for action port [ 1686.043820] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGHEST for action security_group_rules [ 1686.043957] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGHEST for action security_group_members [ 1686.044082] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8778757e-fca1-410f-8a35-ca0c49b2d8f0 with Priority: HIGHEST for action port [ 1686.044621] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.044752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.044821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.045067] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.045110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1686.045258] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.045357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.045418] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.045624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.045704] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.047067] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.047239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.047239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.047359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.047442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1686.047607] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.047704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.047767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.047922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.048102] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.052184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.052184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.052184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.052184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1686.052184] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.052184] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.052184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.052184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.052184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.052184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1686.052184] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-8778757e-fca1-410f-8a35-ca0c49b2d8f0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.052184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8778757e-fca1-410f-8a35-ca0c49b2d8f0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.052184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8778757e-fca1-410f-8a35-ca0c49b2d8f0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.052184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8778757e-fca1-410f-8a35-ca0c49b2d8f0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.052184] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8778757e-fca1-410f-8a35-ca0c49b2d8f0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.094823] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.097289] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.097424] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.097496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.097702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.097790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1686.098058] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.098058] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.100765] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8778757e-fca1-410f-8a35-ca0c49b2d8f0 with status ACTIVE [ 1686.100942] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.101079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.101150] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.101369] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.101460] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1686.101628] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.101726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.101792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.101938] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.102046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1686.105766] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1686.115362] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.115522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.115571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.116086] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.116086] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1686.116086] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 is going to be created. [ 1686.156196] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.156413] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.156413] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.156611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.157302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1686.169008] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 in Status: UNINITIALIZED for 2s [ 1686.461364] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.461524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.461569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.461778] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.461860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1686.461987] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8778757e-fca1-410f-8a35-ca0c49b2d8f0 is going to be updated. [ 1686.486651] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1686.486806] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1686.486869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1686.487071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1686.487211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1686.487415] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8778757e-fca1-410f-8a35-ca0c49b2d8f0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.183735] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 in Status: SUCCESS [ 1688.184064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.184155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.184367] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.184560] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.184678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1688.184744] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.184894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.184973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.185059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.185149] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1688.195735] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.195888] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1688.195957] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.196194] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.196269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.196416] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.196527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1688.196588] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.196717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.196856] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.196942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1688.197003] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.197138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.197211] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.197295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.197458] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.197547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1688.197607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.197737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.197800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.197940] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.198049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1688.198130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.198216] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.198390] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.198479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1688.198541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.198673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.198746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.198825] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.198938] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1688.212915] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 434c81a0-40dd-4119-b850-8a8e4707a3f9: rpc.has_security_group_logging(os_id): False [ 1688.233197] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.233197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1688.233197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.233197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.233197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.233413] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.233413] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1688.233498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.233596] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.233673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.233916] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.233989] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1688.234034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.234166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.234238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.234426] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.234513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1688.234570] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.234704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.234775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.234856] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 is going to be created. [ 1688.297598] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1688.297797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1688.297846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1688.298025] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1688.298220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1688.311766] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 in Status: IN_PROGRESS for 2s [ 1690.325757] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 in Status: SUCCESS [ 1690.326076] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1691.045048] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1691.045167] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1696.046393] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1696.046732] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1701.047189] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1701.047553] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1706.048234] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1706.048596] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1711.049586] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1711.050002] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1716.050682] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1716.051122] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1717.003194] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:4 completed [ 1717.003387] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:5 started [ 1721.052250] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1721.052633] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1721.829170] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.829373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1721.829491] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1721.829805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1721.829910] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1721.830088] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1721.830236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1721.830342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1721.830594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1721.830767] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1721.839920] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1721.846428] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1721.852758] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1721.852858] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1722.570940] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.571458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.571458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.571458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.584648] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1722.585128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.585852] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1722.613394] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.613704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.613704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.613850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.621570] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.622150] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1722.622324] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1722.622415] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1722.646749] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.647043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.647043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.647198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.647544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.647780] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1722.694465] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.694697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.694697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.694881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.695112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.695291] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1722.736154] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.736390] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.736484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.736620] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.736801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.736977] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:12. [ 1722.737063] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b1620446-f273-4658-baad-13a497dabc74', '3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b', 'e583f7e5-364a-4a33-9784-9c313528bb3d', '3ffcb57e-8678-415b-bd13-19b60dbd45bd', '9f129921-ca53-4911-9bcc-7d661d45384d', '809c9d4c-eb3e-493d-bbfc-45d99fd37e44', 'bbf8f627-b3e9-41d3-bf72-822741bb5374', '8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0', '5a2644aa-f99a-4b14-9145-702ba5c8452b', '434c81a0-40dd-4119-b850-8a8e4707a3f9', '8ccdfdda-5544-48a2-976b-b365f092bbb9', '5233168b-5f93-4bb0-bac2-dd279d965d46'} {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1722.737171] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1722.755095] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.755288] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.755370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.755506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.755593] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.755700] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1722.755769] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1722.755830] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1722.799416] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.799575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.799671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.799889] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.800410] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.800637] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1722.800720] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1722.800794] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1722.800862] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1722.800942] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 12/12 resources of Type:Security Group Rules [ 1722.801041] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGH for action security_group_rules [ 1722.801124] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGH for action security_group_rules [ 1722.801193] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGH for action security_group_rules [ 1722.801258] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 1722.801321] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGH for action security_group_rules [ 1722.801384] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGH for action security_group_rules [ 1722.801447] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGH for action security_group_rules [ 1722.801509] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 1722.801571] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 1722.801647] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGH for action security_group_rules [ 1722.801729] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGH for action security_group_rules [ 1722.801795] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 1722.801865] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1722.801929] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1722.802114] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.802206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.802271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.802431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.802508] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.802671] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.802761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.802821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.802979] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.803078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.803247] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.803374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.803435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.803575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.803649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.803813] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.803901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.803960] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.804109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.804193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.804388] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.804482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.804540] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.804677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.804748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.804907] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.804995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.805056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.805188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.805260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.805422] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.805548] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.805635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.805789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.805864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.806027] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.806119] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.806178] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.806313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.806385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.806550] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.806639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.806697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.806846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.806935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.807100] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.807193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.807251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.807386] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.807459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.807618] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.807707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.807765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.807896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.807968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.808182] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.808277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.808445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.808592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.808667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.808828] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.808918] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.808977] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.809112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.809184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.809350] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.809515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.809515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.809717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.809802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.809967] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.810059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.810118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.810313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.810392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.810591] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.810712] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.810772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.810913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.811006] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.811164] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.811256] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.811315] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.811452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.811525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.811685] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.811788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.811863] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.812039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.812207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.812288] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.812378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.812436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.812572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.812645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.812805] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.812893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.812951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.813108] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.813186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.813350] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.813477] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.813537] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.813675] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.813748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.813908] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.813997] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.814058] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.814189] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.814261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.814458] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.814551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.814610] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.814744] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.814816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.814976] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.815067] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.815125] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.815257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.815329] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.815486] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.815593] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.815665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.815802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.815875] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.816047] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.816140] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.816198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.816332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.816405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.816564] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1722.816653] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1722.816710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1722.816850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1722.816923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1722.817023] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:3 [ 1722.817092] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 3 of least updated resources [ 1722.817170] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGH for action security_group_members [ 1722.817254] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGH for action security_group_members [ 1722.817322] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGH for action security_group_members [ 1722.817411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.053250] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1726.053585] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=15], Jobs=0 [ 1726.053585] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGH for action security_group_rules [ 1726.053648] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGH for action security_group_rules [ 1726.053714] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGH for action security_group_rules [ 1726.053811] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 with Priority: HIGH for action security_group_members [ 1726.053909] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1266a9f5-7050-4473-ad65-329e9724ea7d with Priority: HIGH for action security_group_members [ 1726.054005] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 with Priority: HIGH for action security_group_members [ 1726.054097] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 1726.054188] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGH for action security_group_rules [ 1726.054281] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGH for action security_group_rules [ 1726.054372] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 1726.054460] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGH for action security_group_rules [ 1726.054547] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 1726.054634] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGH for action security_group_rules [ 1726.054721] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGH for action security_group_rules [ 1726.054809] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 1726.055173] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.055313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.055378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.055584] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.055667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.055824] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.055921] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.055982] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.056192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.056277] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.057234] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.057348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.057415] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.057562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.057638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.057777] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.057867] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.057926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.058064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.058143] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.058971] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.059080] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.059147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.059297] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.059373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.059510] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.059602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.059663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.059801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.059870] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.060838] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.060946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.061035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.061189] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.061267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.061407] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.061499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.061561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.061698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.064206] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.064323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.064393] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.064552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.064636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.064720] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('905dd5f8-1bc0-4560-8294-1733c7eaf6f4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.065457] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.065540] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.065608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.065761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.065837] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.065978] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-1266a9f5-7050-4473-ad65-329e9724ea7d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.066073] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.066135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.066275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.066407] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.066496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.066556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.066689] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.066764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.066843] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1266a9f5-7050-4473-ad65-329e9724ea7d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.067524] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.067633] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.067700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.067846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.067945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.068066] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-627ba6ea-f974-4510-aa7b-1807964b9b40 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.068161] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.068242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.068360] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.068519] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.068616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.068676] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.068814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.068889] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.068969] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('627ba6ea-f974-4510-aa7b-1807964b9b40',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.069729] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.069840] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.069907] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.070053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.070130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.070267] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.070358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.070420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.070556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.070625] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.071334] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.071455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.071527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.071680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.071753] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.071892] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.072017] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.072080] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.072222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.072292] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.072950] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.073058] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.073127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.073270] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.073344] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.073478] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.073579] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.073618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.073750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.073818] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.074490] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.074603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.074671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.074814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.074889] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.075027] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.075120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.075181] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.075318] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.075387] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.076161] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.076271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.076337] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.076484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.076559] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.076694] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.076784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.076844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.077012] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.077048] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.077724] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.077834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.077900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.078222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.078222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.078316] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.078405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.078465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.078603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.078671] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.079330] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.079437] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.079504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.079647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.079722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.079857] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.079947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.080015] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.080160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.080228] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.080899] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.081047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.081096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.081240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.081316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.081451] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.081541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.081602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.081738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.081807] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.082547] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.082649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.082716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.082860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.082936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.083073] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.083165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.083226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.083382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.083454] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.107967] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.108364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.108528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.108902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.109091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.109377] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.109603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.109752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.109995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.110160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.110325] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1266a9f5-7050-4473-ad65-329e9724ea7d is going to be deleted. [ 1726.111668] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.111910] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.112084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.112327] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.112496] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.112752] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.112949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.113089] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.113319] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.113488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.113665] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 905dd5f8-1bc0-4560-8294-1733c7eaf6f4 is going to be deleted. [ 1726.133115] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.133501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.133652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.133923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.134084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.134319] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.134546] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.134682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.134902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.135132] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.135330] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.135470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.135679] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.135861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.136032] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.136190] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.139143] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.139143] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.139143] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.139143] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.139348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.139378] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.139452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.139559] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.139657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.139737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.139826] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627ba6ea-f974-4510-aa7b-1807964b9b40 is going to be deleted. [ 1726.141586] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.141697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.141766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.141926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.142026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.142180] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.142277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.142340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.142492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.142632] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.142725] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.142787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.142972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.143020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.143080] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.143167] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.150836] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.150959] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.151051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.151263] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.151374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.151534] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.151632] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.151696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.151850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.152019] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.152131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.152195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.152341] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.152418] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.152501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.152652] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.152745] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.152825] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.153003] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.153159] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.153327] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.153483] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.153589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.153836] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.153889] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.153964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.154024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.154165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.154241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.154322] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.154942] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.156159] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.156277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.156339] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.156490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.156574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.156667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1266a9f5-7050-4473-ad65-329e9724ea7d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.157471] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.157580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.157649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.157800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.157881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.157975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-905dd5f8-1bc0-4560-8294-1733c7eaf6f4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.159789] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.165520] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.165715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.165768] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.165912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.165999] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.166159] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.166283] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.166314] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.166458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.166600] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.166691] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.166752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.166891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.166999] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.167082] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.167168] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.171398] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.171506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.171577] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.171737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.171818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.171975] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.172126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.172196] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.172347] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.172489] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.172582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.172645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.172781] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.172874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.172931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.173328] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.176036] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1620446-f273-4658-baad-13a497dabc74: rpc.has_security_group_logging(os_id): False [ 1726.179532] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.179668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.179872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.180129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.180239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.180339] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627ba6ea-f974-4510-aa7b-1807964b9b40" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.181267] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.181380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.181450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.181616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.189526] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.189679] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.189722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.189909] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.190245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.190430] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.190556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.190582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.190745] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.190888] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.191163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.191163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.191242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.191270] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.191352] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.191439] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.192325] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.192437] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.192508] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.192661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.192741] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.192886] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.192975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.193038] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.193181] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.193324] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.193404] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.193453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.193592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.193666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.193746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.193828] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.197426] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e583f7e5-364a-4a33-9784-9c313528bb3d: rpc.has_security_group_logging(os_id): False [ 1726.198525] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.198653] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.198701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.198888] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.198973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.199124] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.199221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.199285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.199436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.199575] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.199668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.199730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.199881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.199938] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.200032] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.200119] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.200897] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.201032] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.201142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.201303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.201383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.201526] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.201671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.201671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.201814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.201949] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.202065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.202132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.202275] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.202351] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.202432] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.202513] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.203267] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.203449] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.203523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.203729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.203860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.204070] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.204178] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.204242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.204457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.204530] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.204621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.204743] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.204864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.204994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.205123] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.205287] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.205386] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.205445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.205609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.205694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.205856] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.205954] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.206016] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.206269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.206357] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.206402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.206459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.206665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.206764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.206853] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.206938] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.209457] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.209555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.210327] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.210424] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.211186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.211256] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 is going to be deleted. [ 1726.215993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.216266] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.217317] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.218274] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.218411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.218558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.218661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.218758] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.218972] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.219098] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.219166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.219327] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.219474] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.219570] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.219634] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.219776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.219854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.219936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.220099] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.220193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.220252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.220393] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.220466] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.220602] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.220774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.220774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.220880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.221036] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.221122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.221210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.221311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.221387] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.221469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.221556] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.222880] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.222956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.223026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.223452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.223452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.223452] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.223638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.223638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.223695] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.223893] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.223893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.223986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.224124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.224205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.224289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.224438] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.224531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.224593] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.224815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.224815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.224973] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.225019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.225071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.225209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.225341] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.225431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.225490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.225626] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.225700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.225779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.225863] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.229836] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.229952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.230021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.230191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.230273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.230427] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.230505] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.230568] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.230712] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.230853] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.230949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.231008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.231144] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.231222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.231303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.231451] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.231542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.231604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.231743] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.231816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.231956] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.232075] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.232142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.232283] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.232417] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.232682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.232682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.232682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.232769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.232830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.232918] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.233861] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.233861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.233958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.234056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.234152] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.234355] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.234355] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.234468] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.234575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.234678] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.234768] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.234828] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.234992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.235035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.235108] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.235256] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.235346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.235408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.235546] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.235620] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.235772] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.235841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.235903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.236095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.236198] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.236290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.236349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.236484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.236558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.236639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.236725] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1726.237488] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0: rpc.has_security_group_logging(os_id): False [ 1726.240627] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ccdfdda-5544-48a2-976b-b365f092bbb9: rpc.has_security_group_logging(os_id): False [ 1726.242286] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f129921-ca53-4911-9bcc-7d661d45384d: rpc.has_security_group_logging(os_id): False [ 1726.242963] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 809c9d4c-eb3e-493d-bbfc-45d99fd37e44: rpc.has_security_group_logging(os_id): False [ 1726.246885] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.247107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.250944] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 434c81a0-40dd-4119-b850-8a8e4707a3f9: rpc.has_security_group_logging(os_id): False [ 1726.253546] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a2644aa-f99a-4b14-9145-702ba5c8452b: rpc.has_security_group_logging(os_id): False [ 1726.288873] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.289113] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.290339] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.290471] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.291466] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.291583] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.291714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.291774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.292072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.292197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.292438] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.292543] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.292609] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.292790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.292871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.293064] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.293140] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.293204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.293346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.293423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.293518] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1620446-f273-4658-baad-13a497dabc74 is going to be updated. [ 1726.295292] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.295418] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.295490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.295646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.297224] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.297322] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.298051] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.298173] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.299293] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.299515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.300237] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.300333] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.301138] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.301250] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.326690] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.327014] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.327120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.327188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.327388] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.327480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.327570] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e583f7e5-364a-4a33-9784-9c313528bb3d is going to be updated. [ 1726.328704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.328884] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.332983] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.333128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.349782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.351145] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.351145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.351145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.351145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.351145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.351145] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.351145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.351145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.351145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.351145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.351465] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.351465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.351465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.351657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.351720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.351824] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 1726.353348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.353348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.369392] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.369570] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.375486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.375754] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.375877] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.375945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.376165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.376249] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.376446] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.376543] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.376606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.376759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.376834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.377019] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.377102] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.377164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.377304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.377379] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.377512] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 is going to be updated. [ 1726.378559] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.378715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.411568] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.411721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.412641] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.412768] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b is going to be deleted. [ 1726.413880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.414052] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.444654] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.444814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.480625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.480796] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be deleted. [ 1726.481946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.482228] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.548499] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.548735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.559711] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.559962] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.561138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.561509] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.561671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.561786] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.562428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.562613] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.562776] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f129921-ca53-4911-9bcc-7d661d45384d is going to be updated. [ 1726.564046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.564318] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.600344] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.600579] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.634349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.634737] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.634953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.635095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.635393] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.635549] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.635798] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.635971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.636107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.636334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.636497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.636703] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.636839] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.636944] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.637138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.637269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.637644] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1726.639006] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.639276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.639485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.639659] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.639844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.640062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.697523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.698053] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.698320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.698516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.698837] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.698991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.699297] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.699487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.699599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.699853] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.700148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.700429] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.700577] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.700687] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.700905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.701169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.701637] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 is going to be updated. [ 1726.702936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.703177] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.766757] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.766923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.769354] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.769554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.792328] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.792566] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be deleted. [ 1726.793595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.794033] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.794033] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.795142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.795380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.795548] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.797571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.797747] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.797929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.798085] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.798618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.798812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.816375] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 in Status: IN_PROGRESS for 2s [ 1726.817177] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1726.836707] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.836903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.859164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.859472] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.859742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.859841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.860100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.860190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.860788] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.860916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.861035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.861195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.861277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.861485] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.861564] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.861627] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.861775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.861852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.861984] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 is going to be updated. [ 1726.863776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.863949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.864051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.864180] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.864325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.864475] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.864619] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.865657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.865824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.865954] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.866928] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.867097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.867233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.868585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.868798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.868798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.869732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.869895] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.870027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.901488] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1726.901667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1726.901704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1726.901999] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1726.902127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.902254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1726.906403] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1620446-f273-4658-baad-13a497dabc74 in Status: IN_PROGRESS for 2s [ 1726.907157] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f129921-ca53-4911-9bcc-7d661d45384d in Status: IN_PROGRESS for 2s [ 1726.907726] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 in Status: IN_PROGRESS for 2s [ 1726.908474] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e583f7e5-364a-4a33-9784-9c313528bb3d in Status: IN_PROGRESS for 2s [ 1726.910245] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1727.013388] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1727.013600] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1727.013600] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1727.013815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1727.013970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1727.031846] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 in Status: IN_PROGRESS for 2s [ 1727.117624] env[61817]: INFO networking_nsxv3.common.synchronization [req-a6d3a571-b087-40f8-ad62-d645b94bd18c req-94f6f8a2-6aa6-4bcf-b8e4-fb94f3a03a95 tempest-TaggedAttachmentsTest-1373114596 tempest-TaggedAttachmentsTest-1373114596-project-member] Enqueued Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGHEST for action security_group_members [ 1727.117624] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGHEST for action security_group_members [ 1727.117624] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1727.117624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1727.117624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1727.117624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1727.117624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1727.117624] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1727.117624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1727.117624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1727.118109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1727.118109] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1727.118109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1727.118109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1727.118232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1727.118232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1727.118291] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1727.128659] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1727.128799] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1727.128866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1727.129081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1727.129179] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1727.129608] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1727.129763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1727.129833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1727.129999] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1727.130085] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1727.130296] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f129921-ca53-4911-9bcc-7d661d45384d is going to be updated. [ 1727.174147] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1727.174291] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1727.174361] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1727.174566] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1727.174715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1727.184466] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f129921-ca53-4911-9bcc-7d661d45384d in Status: IN_PROGRESS for 2s [ 1728.030736] env[61817]: INFO networking_nsxv3.common.synchronization [req-eecad92e-0e7a-48ab-9d44-020c1433ced7 req-d48e1458-f55c-44fe-be60-a5442b767321 tempest-ServerDiskConfigTestJSON-1489146392 tempest-ServerDiskConfigTestJSON-1489146392-project-member] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1728.031304] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1728.031934] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.032107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.032176] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.032373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.032454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.032612] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.032711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.032779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.032926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.033062] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.033162] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.033227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.033452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.033488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.033554] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1728.043242] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.043394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.043446] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.043611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.043698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.043874] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.044056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.044128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.044279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.044361] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.044456] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be deleted. [ 1728.070719] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.070863] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.070930] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.071220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.071317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.071415] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.350158] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.350467] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.350588] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.350828] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.351042] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.351325] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.351493] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.351626] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.351843] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.352131] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.352297] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.352417] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.352637] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.352784] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.352933] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.353184] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.353365] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.353497] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.353712] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.353874] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.354133] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-06b5332a-e1df-4ef6-80a4-0f91c41e7c91 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.354350] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-06b5332a-e1df-4ef6-80a4-0f91c41e7c91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.354419] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-06b5332a-e1df-4ef6-80a4-0f91c41e7c91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.354723] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-06b5332a-e1df-4ef6-80a4-0f91c41e7c91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.354882] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06b5332a-e1df-4ef6-80a4-0f91c41e7c91',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1728.377866] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.378090] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.378225] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.378498] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.378655] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.378807] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 06b5332a-e1df-4ef6-80a4-0f91c41e7c91 not found, creating... [ 1728.379128] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.379238] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.379355] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.379582] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.379727] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.380036] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.380185] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.380307] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.380520] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.380660] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.380803] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 06b5332a-e1df-4ef6-80a4-0f91c41e7c91 is going to be created. [ 1728.404451] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.404712] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.404846] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.405133] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.405376] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.405611] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-06b5332a-e1df-4ef6-80a4-0f91c41e7c91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.619129] env[61817]: INFO networking_nsxv3.common.synchronization [req-eecad92e-0e7a-48ab-9d44-020c1433ced7 req-9b52512b-9287-4e3b-be75-ed9b48a7ccc2 service neutron] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_rules [ 1728.619348] env[61817]: INFO networking_nsxv3.common.synchronization [req-eecad92e-0e7a-48ab-9d44-020c1433ced7 req-9b52512b-9287-4e3b-be75-ed9b48a7ccc2 service neutron] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1728.619532] env[61817]: INFO networking_nsxv3.common.synchronization [req-eecad92e-0e7a-48ab-9d44-020c1433ced7 req-9b52512b-9287-4e3b-be75-ed9b48a7ccc2 service neutron] Enqueued Resource ID: 06b5332a-e1df-4ef6-80a4-0f91c41e7c91 with Priority: HIGHEST for action port [ 1728.619978] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_rules [ 1728.620138] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1728.620237] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b5332a-e1df-4ef6-80a4-0f91c41e7c91 with Priority: HIGHEST for action port [ 1728.620910] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.621071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.621135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.621325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.621412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.621581] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.621685] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.621750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.621906] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.622001] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1728.622995] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.622995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.623090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.623190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.623314] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.624304] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.624453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.624525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.624681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.630138] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.630138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.630138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.630138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.630138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.630138] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1728.630138] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.630138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.630138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.630138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.630138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.630138] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-06b5332a-e1df-4ef6-80a4-0f91c41e7c91 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.630138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06b5332a-e1df-4ef6-80a4-0f91c41e7c91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.630138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06b5332a-e1df-4ef6-80a4-0f91c41e7c91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.630138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06b5332a-e1df-4ef6-80a4-0f91c41e7c91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.630138] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06b5332a-e1df-4ef6-80a4-0f91c41e7c91',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1728.643313] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1728.656268] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.656691] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.656808] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.657024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.657117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.657394] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.657539] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.661321] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1728.662479] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06b5332a-e1df-4ef6-80a4-0f91c41e7c91 with status ACTIVE [ 1728.662662] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.662758] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.662820] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.663028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.663142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.663331] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.663447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.663492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.663632] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.663706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.667871] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.668032] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.668095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.668265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.668345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.668431] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be created. [ 1728.702644] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1728.702809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1728.702809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1728.703014] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1728.703220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.713375] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: UNINITIALIZED for 2s [ 1728.832995] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 in Status: SUCCESS [ 1728.833253] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.834178] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1728.834382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.924045] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f129921-ca53-4911-9bcc-7d661d45384d in Status: SUCCESS [ 1728.924420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.925188] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e583f7e5-364a-4a33-9784-9c313528bb3d in Status: SUCCESS [ 1728.925364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.925985] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1620446-f273-4658-baad-13a497dabc74 in Status: SUCCESS [ 1728.926163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.926768] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 in Status: SUCCESS [ 1728.926937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1728.927533] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1728.927704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1729.015134] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1729.015332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1729.015373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1729.015658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1729.015762] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1729.015867] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06b5332a-e1df-4ef6-80a4-0f91c41e7c91 is going to be updated. [ 1729.037314] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1729.037489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1729.037556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1729.037790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1729.037935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1729.038115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06b5332a-e1df-4ef6-80a4-0f91c41e7c91" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1729.046365] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 in Status: SUCCESS [ 1729.046606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1729.196584] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f129921-ca53-4911-9bcc-7d661d45384d in Status: SUCCESS [ 1729.196774] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f129921-ca53-4911-9bcc-7d661d45384d deletion is rescheduled due to dependency. [ 1729.196896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.723786] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1730.724120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.724176] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.724394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.724599] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.724714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1730.724780] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.724971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.725112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.725246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.725345] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1730.734122] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.734294] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1730.734391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.734604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.734739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.734941] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.735074] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1730.735159] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.735352] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.735542] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.735672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1730.735767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.735949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.736991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.737150] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.737318] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.737416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1730.737482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.737630] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.737758] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.737965] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.738095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1730.738182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.738378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.738526] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.738644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1730.738724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.738919] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.739031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.739139] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.739252] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1730.745816] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5233168b-5f93-4bb0-bac2-dd279d965d46: rpc.has_security_group_logging(os_id): False [ 1730.764370] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.764575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1730.764698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.765115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.765115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.765263] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.765389] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1730.765474] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.765649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.765753] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.766118] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.766118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1730.766118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.766393] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.766537] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.766774] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.766912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1730.767239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.767239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.767239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.767357] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be created. [ 1730.829937] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1730.830133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1730.830133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1730.830420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1730.830638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1730.842247] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1732.855831] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1732.856208] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1733.621231] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1733.621337] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1738.622179] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1738.622470] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1743.623427] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1743.623748] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1748.624166] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1748.624552] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1753.625290] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1753.625629] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1758.626624] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1758.626974] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1763.628111] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1763.628410] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1768.629459] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1768.629805] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1773.630319] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1773.630601] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1778.393843] env[61817]: INFO networking_nsxv3.common.synchronization [req-11126721-00e1-467d-8944-084a1fed6530 req-b14d9a32-9374-4188-b582-4a619a0d21a3 tempest-ImagesTestJSON-1042540315 tempest-ImagesTestJSON-1042540315-project-member] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 1778.394377] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 1778.394702] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.394832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.394901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.395104] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.395191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1778.395350] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.395447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.395509] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.395658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.395797] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.395890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.395952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.396105] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.396188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1778.396311] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1778.408037] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1778.419458] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1778.428964] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.429144] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.429220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.429432] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.429528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1778.429623] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1778.463685] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.463910] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.463986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.464228] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.464385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1778.480731] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1778.688034] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.688034] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.688238] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.688400] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.688549] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1778.688807] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-16 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.689051] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.689235] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.689475] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.689728] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.689886] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.690008] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.690220] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.690360] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1778.690507] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1778.690754] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.690908] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.691086] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.691756] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.691957] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1778.692272] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-160891cf-8fe2-484f-9a30-b133226db788 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.692474] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-160891cf-8fe2-484f-9a30-b133226db788" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.692626] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-160891cf-8fe2-484f-9a30-b133226db788" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.692925] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-160891cf-8fe2-484f-9a30-b133226db788" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.693138] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('160891cf-8fe2-484f-9a30-b133226db788',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1778.712828] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.713068] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.713265] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.713586] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.713791] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1778.714004] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 160891cf-8fe2-484f-9a30-b133226db788 not found, creating... [ 1778.714348] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.714540] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.714694] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.714990] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.715348] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1778.715707] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.715941] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.716125] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.716387] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.716557] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1778.716734] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 160891cf-8fe2-484f-9a30-b133226db788 is going to be created. [ 1778.794444] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1778.794765] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1778.794939] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1778.795259] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1778.795619] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1778.795974] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-160891cf-8fe2-484f-9a30-b133226db788" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1779.021556] env[61817]: INFO networking_nsxv3.common.synchronization [req-11126721-00e1-467d-8944-084a1fed6530 req-1a67d859-0b5f-4f83-aebb-7324180ab79a service neutron] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_rules [ 1779.021732] env[61817]: INFO networking_nsxv3.common.synchronization [req-11126721-00e1-467d-8944-084a1fed6530 req-1a67d859-0b5f-4f83-aebb-7324180ab79a service neutron] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 1779.021871] env[61817]: INFO networking_nsxv3.common.synchronization [req-11126721-00e1-467d-8944-084a1fed6530 req-1a67d859-0b5f-4f83-aebb-7324180ab79a service neutron] Enqueued Resource ID: 160891cf-8fe2-484f-9a30-b133226db788 with Priority: HIGHEST for action port [ 1779.022129] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_rules [ 1779.022254] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 1779.022346] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 160891cf-8fe2-484f-9a30-b133226db788 with Priority: HIGHEST for action port [ 1779.022949] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.023071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1779.023137] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1779.023340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1779.023421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1779.023574] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.023665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1779.023722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1779.023865] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1779.023939] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1779.025147] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.025246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1779.025310] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1779.025480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1779.025557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1779.025698] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.025776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1779.026007] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.026074] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1779.026116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1779.026261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1779.026331] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1779.026464] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-160891cf-8fe2-484f-9a30-b133226db788 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.026545] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-160891cf-8fe2-484f-9a30-b133226db788" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1779.026604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-160891cf-8fe2-484f-9a30-b133226db788" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1779.026739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-160891cf-8fe2-484f-9a30-b133226db788" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1779.026808] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('160891cf-8fe2-484f-9a30-b133226db788',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1779.044283] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.044618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1779.044618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1779.044897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1779.045040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1779.045272] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.045408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1779.048351] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 160891cf-8fe2-484f-9a30-b133226db788 with status ACTIVE [ 1779.048522] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.048721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1779.048721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1779.048871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1779.048953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1779.049142] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.049237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1779.049295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1779.049444] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1779.049517] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1779.480298] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.480705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1779.480705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1779.480866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1779.481077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1779.481199] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 160891cf-8fe2-484f-9a30-b133226db788 is going to be updated. [ 1779.504324] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1779.504578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1779.504578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1779.504751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1779.504891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1779.505058] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-160891cf-8fe2-484f-9a30-b133226db788" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1780.490421] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1780.490754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1780.490806] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1780.491040] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1780.491228] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1780.491348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1780.491411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1780.491573] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1780.491658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1780.491754] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1780.499704] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1780.508251] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1780.515628] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1780.515695] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1780.515792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1780.515968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1780.516069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1780.516165] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1780.542751] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1780.542918] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1780.542918] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1780.543121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1780.543273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1780.554193] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1782.564966] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1782.565364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.565409] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.565598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.565790] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1782.565904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1782.565964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.566175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.566382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.566487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.566587] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1782.575779] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1782.575890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1782.575963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.576152] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.576236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.576389] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1782.576486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1782.576548] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.576698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.576835] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1782.576926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1782.576988] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.577126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.577205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.577284] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.577432] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1782.577522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1782.577583] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.577721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.577793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.577930] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1782.578019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1782.578079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.578215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.578345] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1782.578434] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1782.578494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.578628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.578702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.578780] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.578863] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1782.584571] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a2644aa-f99a-4b14-9145-702ba5c8452b: rpc.has_security_group_logging(os_id): False [ 1782.602215] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1782.602405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1782.602471] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.602612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.602681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.602895] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1782.602993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1782.603056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.603201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.603287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.603489] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1782.603587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1782.603649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.603790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.603858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.604047] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1782.604144] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1782.604203] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.604342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.604415] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.604498] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1782.659199] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1782.659468] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1782.659607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1782.659861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1782.660046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1782.672983] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1784.023086] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1784.023390] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1784.686643] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1784.686880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1789.023870] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1789.024173] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1794.025235] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1794.025634] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1799.026624] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1799.026910] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1804.027229] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1804.027627] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1809.027860] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1809.028275] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1814.028980] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1814.028980] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1819.030383] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1819.030627] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1824.031663] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1824.031663] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1826.887622] env[61817]: INFO networking_nsxv3.common.synchronization [req-e2dacbe9-402b-42c1-803f-4545a5563227 req-5df60f8a-47c3-4bca-9550-119e83787ce6 tempest-ServerTagsTestJSON-3206530 tempest-ServerTagsTestJSON-3206530-project-member] Enqueued Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGHEST for action security_group_members [ 1826.888393] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGHEST for action security_group_members [ 1826.888672] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.888795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1826.888865] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1826.889056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1826.889154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1826.889279] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.889392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1826.889438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1826.889583] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1826.889714] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.889809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1826.889878] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1826.890031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1826.890106] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1826.890187] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1826.899395] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.899514] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1826.899615] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1826.899732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1826.899813] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1826.900014] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.900126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1826.900166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1826.900308] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1826.900383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1826.900465] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1620446-f273-4658-baad-13a497dabc74 is going to be updated. [ 1826.935764] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1826.935911] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1826.935981] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1826.936210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1826.936353] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1826.946104] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1620446-f273-4658-baad-13a497dabc74 in Status: IN_PROGRESS for 2s [ 1827.783555] env[61817]: INFO networking_nsxv3.common.synchronization [req-f2f5ea90-8b0b-41d5-ba66-58f170f98acf req-1847fdf9-7533-407f-a0d4-e30517ce319c tempest-ServersTestJSON-1722207346 tempest-ServersTestJSON-1722207346-project-member] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1827.783555] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1827.783555] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.783555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1827.783555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1827.783555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1827.783555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1827.783555] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.783555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1827.783555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1827.783555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1827.783555] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.783555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1827.783555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1827.783555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1827.783555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1827.783555] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1827.800667] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.800667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1827.800667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1827.800667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1827.800667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1827.800667] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.800667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1827.800667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1827.800667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1827.800667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1827.800667] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be deleted. [ 1827.830777] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1827.830930] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1827.830994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1827.831236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1827.831336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1827.831435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.056021] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.056021] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.056021] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.056433] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.056433] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.056498] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-463 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.056644] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.056751] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.056973] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.057268] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.057372] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.057489] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.057695] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.057829] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.057974] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.058216] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.058368] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.058483] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.058687] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.058815] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.059049] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-aaf2b96c-bdf2-45b6-a242-1305fe99123a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.059198] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-aaf2b96c-bdf2-45b6-a242-1305fe99123a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.059346] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-aaf2b96c-bdf2-45b6-a242-1305fe99123a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.059603] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-aaf2b96c-bdf2-45b6-a242-1305fe99123a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.059742] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaf2b96c-bdf2-45b6-a242-1305fe99123a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1828.074913] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.075128] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.075259] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.075523] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.075708] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.075828] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port aaf2b96c-bdf2-45b6-a242-1305fe99123a not found, creating... [ 1828.076100] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.076267] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.076390] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.076610] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.076752] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.077039] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.077199] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.077318] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.077529] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.077660] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.077802] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: aaf2b96c-bdf2-45b6-a242-1305fe99123a is going to be created. [ 1828.103729] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.103938] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.104082] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.104361] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.104591] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.104852] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-aaf2b96c-bdf2-45b6-a242-1305fe99123a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.323326] env[61817]: INFO networking_nsxv3.common.synchronization [req-f2f5ea90-8b0b-41d5-ba66-58f170f98acf req-e359b23b-77b2-4bfe-b072-59d17ff932f5 service neutron] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_rules [ 1828.323564] env[61817]: INFO networking_nsxv3.common.synchronization [req-f2f5ea90-8b0b-41d5-ba66-58f170f98acf req-e359b23b-77b2-4bfe-b072-59d17ff932f5 service neutron] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1828.323715] env[61817]: INFO networking_nsxv3.common.synchronization [req-f2f5ea90-8b0b-41d5-ba66-58f170f98acf req-e359b23b-77b2-4bfe-b072-59d17ff932f5 service neutron] Enqueued Resource ID: aaf2b96c-bdf2-45b6-a242-1305fe99123a with Priority: HIGHEST for action port [ 1828.324458] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_rules [ 1828.324596] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 1828.324695] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf2b96c-bdf2-45b6-a242-1305fe99123a with Priority: HIGHEST for action port [ 1828.324984] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.325111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.325182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.325385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.325472] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.325626] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.325722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.325794] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.325947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.326051] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1828.326862] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.326975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.327047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.327214] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.327303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.327449] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.327544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.327603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.327748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.330240] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.330240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.330240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.330240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.330240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.330240] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1828.330240] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.330240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.330240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.330240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.330240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.330240] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaf2b96c-bdf2-45b6-a242-1305fe99123a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.330240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaf2b96c-bdf2-45b6-a242-1305fe99123a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.330240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaf2b96c-bdf2-45b6-a242-1305fe99123a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.330240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaf2b96c-bdf2-45b6-a242-1305fe99123a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.330240] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaf2b96c-bdf2-45b6-a242-1305fe99123a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1828.346430] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.346565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.346623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.346812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.346891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.347043] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.347130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.347270] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1828.357285] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1828.358383] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aaf2b96c-bdf2-45b6-a242-1305fe99123a with status ACTIVE [ 1828.358569] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.358724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.358803] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.359065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.359108] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.359299] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.359377] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.359461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.359619] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.359693] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.363628] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.363759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.363804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.363980] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.364083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.364185] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be created. [ 1828.401430] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.401714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.401810] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.402024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.402195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.411936] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: UNINITIALIZED for 2s [ 1828.727031] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.727201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.727247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.727464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.727551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.727647] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aaf2b96c-bdf2-45b6-a242-1305fe99123a is going to be updated. [ 1828.748062] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1828.748235] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1828.748285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1828.748560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1828.748646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.748809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaf2b96c-bdf2-45b6-a242-1305fe99123a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1828.956724] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1620446-f273-4658-baad-13a497dabc74 in Status: SUCCESS [ 1828.956931] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1620446-f273-4658-baad-13a497dabc74 deletion is rescheduled due to dependency. [ 1828.957074] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.423320] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 1830.423676] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.423710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.423914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.424140] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.424262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1830.424327] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.424660] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.424660] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.424797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.424797] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.433995] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.434212] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1830.434212] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.434371] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.434460] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.434619] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.434717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1830.434780] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.434927] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.435071] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.435165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1830.435225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.435365] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.435442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.435526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.435673] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.435765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1830.435826] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.435962] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.436050] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.436193] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.436283] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1830.436342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.436479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.436610] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.436700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1830.436760] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.436895] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.436972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.437052] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.437176] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1830.443696] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ffcb57e-8678-415b-bd13-19b60dbd45bd: rpc.has_security_group_logging(os_id): False [ 1830.464200] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.464402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1830.464402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.464616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.464704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.464894] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.464991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1830.465056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.465205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.465284] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.465475] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.465570] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1830.465632] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.465774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.465850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.466033] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.466129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1830.466191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.466331] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.466406] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.466493] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be created. [ 1830.522175] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1830.522374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1830.522374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1830.522587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1830.522769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1830.535561] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 1832.548140] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 1832.548513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1833.325862] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1833.326049] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1838.327050] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1838.327316] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1840.711479] env[61817]: INFO networking_nsxv3.common.synchronization [None req-03ec1bc1-5dc8-4329-98e7-4ef347dff60f None None] Enqueued Resource ID: f1296b18-a65d-4772-9e3f-bd069d98f9b6 with Priority: HIGHEST for action port [ 1840.711753] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1296b18-a65d-4772-9e3f-bd069d98f9b6 with Priority: HIGHEST for action port [ 1840.712332] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.712492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1840.712541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1840.712720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1840.712805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1840.712982] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1296b18-a65d-4772-9e3f-bd069d98f9b6 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.713074] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1296b18-a65d-4772-9e3f-bd069d98f9b6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1840.713105] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1296b18-a65d-4772-9e3f-bd069d98f9b6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1840.713302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1296b18-a65d-4772-9e3f-bd069d98f9b6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1840.713405] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1296b18-a65d-4772-9e3f-bd069d98f9b6',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1840.721843] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1296b18-a65d-4772-9e3f-bd069d98f9b6 [ 1840.722039] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1840.722187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1840.722238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1840.722450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1840.722515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1840.722547] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1296b18-a65d-4772-9e3f-bd069d98f9b6 already deleted. [ 1840.722650] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1296b18-a65d-4772-9e3f-bd069d98f9b6" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1842.568981] env[61817]: INFO networking_nsxv3.common.synchronization [None req-a93b2fd0-e305-4b0a-b237-795368ad2f9b None None] Enqueued Resource ID: 5e0020a3-5b4e-4e8c-8623-39600f916a33 with Priority: HIGHEST for action port [ 1842.569260] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e0020a3-5b4e-4e8c-8623-39600f916a33 with Priority: HIGHEST for action port [ 1842.569811] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.569940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1842.570009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1842.570213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1842.570303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1842.570454] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e0020a3-5b4e-4e8c-8623-39600f916a33 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.570550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e0020a3-5b4e-4e8c-8623-39600f916a33" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1842.570612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e0020a3-5b4e-4e8c-8623-39600f916a33" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1842.570809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e0020a3-5b4e-4e8c-8623-39600f916a33" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1842.570889] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e0020a3-5b4e-4e8c-8623-39600f916a33',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1842.592230] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e0020a3-5b4e-4e8c-8623-39600f916a33 [ 1842.592420] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1842.592552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1842.592622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1842.592816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1842.592905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1842.592996] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e0020a3-5b4e-4e8c-8623-39600f916a33 already deleted. [ 1842.593074] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e0020a3-5b4e-4e8c-8623-39600f916a33" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1847.570041] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1847.570371] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1852.571378] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1852.571747] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1857.572947] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1857.573368] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1862.573935] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1862.574229] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1867.575571] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1867.576095] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1872.576826] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1872.576826] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1876.477661] env[61817]: INFO networking_nsxv3.common.synchronization [req-70200a54-aa7c-4c22-8bc4-77b36bf87bbd req-fe98ba52-c894-457a-b1d0-0e2379028a02 tempest-ImagesTestJSON-1042540315 tempest-ImagesTestJSON-1042540315-project-member] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 1876.477661] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 1876.478232] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.478232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1876.478232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1876.478232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1876.478232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1876.478387] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.478497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1876.478542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1876.478685] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1876.478829] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.478923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1876.479002] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1876.479150] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1876.479238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1876.479327] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1876.487308] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1876.496835] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1876.507887] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.507887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1876.507887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1876.507887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1876.507887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1876.507887] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1876.541259] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1876.541417] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1876.541492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1876.541691] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1876.541842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1876.551446] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1877.393325] env[61817]: INFO networking_nsxv3.common.synchronization [req-e3edebb4-312c-4d5a-9099-8eaa39a25a55 req-1e400013-a84f-412e-ae5a-9ad0caa4f9ad tempest-DeleteServersTestJSON-1745478556 tempest-DeleteServersTestJSON-1745478556-project-member] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1877.393325] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1877.393325] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.393325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.393325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.393325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.393325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.393325] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.393325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.393325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.393325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.393325] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.395596] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.395596] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.395596] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.395596] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.395596] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1877.405871] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1877.417203] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1877.425360] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.426170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.426487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.426779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.426986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.427177] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 1877.464389] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.464571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.464611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.464802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.464953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.477123] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1877.690847] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.691224] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.691376] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.691662] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.691818] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.692216] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-455 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.692430] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.692560] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.692802] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.693068] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.693228] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.693350] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.693564] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.693707] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.693855] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.694109] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.694265] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.694382] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.694588] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.694721] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.694957] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-f908744f-cc27-4cf9-ae1a-597fb169b177 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.695199] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-f908744f-cc27-4cf9-ae1a-597fb169b177" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.695324] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-f908744f-cc27-4cf9-ae1a-597fb169b177" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.695590] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-f908744f-cc27-4cf9-ae1a-597fb169b177" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.695731] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f908744f-cc27-4cf9-ae1a-597fb169b177',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1877.711731] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.711906] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.712058] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.712328] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.712481] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.712633] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port f908744f-cc27-4cf9-ae1a-597fb169b177 not found, creating... [ 1877.712882] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.713051] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.713174] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.713389] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.713530] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.713805] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.713988] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.714116] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.714330] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.714466] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.714607] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: f908744f-cc27-4cf9-ae1a-597fb169b177 is going to be created. [ 1877.735830] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.736070] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.736218] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.736510] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.736746] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.736974] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-f908744f-cc27-4cf9-ae1a-597fb169b177" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.966662] env[61817]: INFO networking_nsxv3.common.synchronization [req-e3edebb4-312c-4d5a-9099-8eaa39a25a55 req-522cd69a-0d41-4c4e-9410-e80e433c3074 service neutron] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_rules [ 1877.966662] env[61817]: INFO networking_nsxv3.common.synchronization [req-e3edebb4-312c-4d5a-9099-8eaa39a25a55 req-522cd69a-0d41-4c4e-9410-e80e433c3074 service neutron] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1877.966662] env[61817]: INFO networking_nsxv3.common.synchronization [req-e3edebb4-312c-4d5a-9099-8eaa39a25a55 req-522cd69a-0d41-4c4e-9410-e80e433c3074 service neutron] Enqueued Resource ID: f908744f-cc27-4cf9-ae1a-597fb169b177 with Priority: HIGHEST for action port [ 1877.966662] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_rules [ 1877.966662] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1877.966662] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f908744f-cc27-4cf9-ae1a-597fb169b177 with Priority: HIGHEST for action port [ 1877.966662] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.966662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.966662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.966662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.966662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.966662] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.966662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.966662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.966662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.969874] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1877.969874] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.969874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.969874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.969874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.969874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.969874] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.969874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.969874] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.969874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.969874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.969874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.969874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.969874] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f908744f-cc27-4cf9-ae1a-597fb169b177 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.970698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f908744f-cc27-4cf9-ae1a-597fb169b177" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.970698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f908744f-cc27-4cf9-ae1a-597fb169b177" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.970698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f908744f-cc27-4cf9-ae1a-597fb169b177" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.970698] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f908744f-cc27-4cf9-ae1a-597fb169b177',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1877.989604] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.989789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.989887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.990127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.990246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.990439] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.990551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.992091] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f908744f-cc27-4cf9-ae1a-597fb169b177 with status ACTIVE [ 1877.992315] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.992456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.992547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.992989] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.992989] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1877.992989] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1877.993132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1877.993213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1877.993397] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1877.993513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1878.461096] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1878.461321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1878.461321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1878.461530] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1878.461623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1878.462758] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f908744f-cc27-4cf9-ae1a-597fb169b177 is going to be updated. [ 1878.485141] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1878.485336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1878.485377] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1878.485571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1878.485715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1878.485879] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f908744f-cc27-4cf9-ae1a-597fb169b177" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1878.562042] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1878.562295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1879.486845] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1879.487218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1879.487304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1879.487530] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1879.487739] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1879.487867] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1879.487934] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1879.488136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1879.488225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1879.488320] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1879.496608] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1879.504561] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1879.511022] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1879.511181] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1879.511246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1879.511450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1879.511556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1879.511651] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 1879.542698] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1879.542881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1879.542948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1879.543155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1879.543308] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1879.554701] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1881.566609] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1881.567000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.567485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.567598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.567727] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.567844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1881.567906] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.568078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.568160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.568242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.568328] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1881.578093] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.578316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1881.578482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.578716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.578804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.579046] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.579172] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1881.579239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.579510] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.579602] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.579709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1881.579773] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.579916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.579996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.580100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.580257] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.580349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1881.580411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.580606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.580682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.580918] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.581013] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1881.581128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.581278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.581418] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.581538] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1881.581604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.581821] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.581881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.582057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.582105] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1881.588646] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0: rpc.has_security_group_logging(os_id): False [ 1881.607176] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.607359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1881.607407] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.607576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.607681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.607872] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.607972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1881.608049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.608208] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.608288] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.608504] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.608612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1881.608677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.608825] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.608902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.609083] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.609178] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1881.609241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.609382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.609458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.609544] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 1881.666375] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1881.666578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1881.666578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1881.666759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1881.666941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1881.678406] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1882.966775] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1882.967128] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1883.692237] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1883.692501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1887.967691] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1887.967945] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1892.969035] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1892.969035] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1897.970073] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1897.970424] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1902.971132] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1902.971521] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1907.972387] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1907.972737] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1912.973504] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1912.973908] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1917.974532] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1917.974866] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1922.976063] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1922.976366] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1927.774221] env[61817]: INFO networking_nsxv3.common.synchronization [req-fa2268ed-9286-4836-8782-67c19dd836dd req-00ee38ea-1342-46a9-9da2-b3574cd77ec9 tempest-AttachVolumeNegativeTest-329748670 tempest-AttachVolumeNegativeTest-329748670-project-member] Enqueued Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGHEST for action security_group_members [ 1927.774793] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGHEST for action security_group_members [ 1927.775147] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.775296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1927.775383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1927.775607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1927.775735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1927.775926] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.776069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1927.776139] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1927.776304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1927.776448] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.776543] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1927.776606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1927.776748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1927.776829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1927.776917] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1927.785879] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.786073] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1927.786186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1927.786399] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1927.786543] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1927.786765] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.786929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1927.787045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1927.787238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1927.787365] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1927.787497] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e583f7e5-364a-4a33-9784-9c313528bb3d is going to be updated. [ 1927.823391] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1927.823545] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1927.823618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1927.823841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1927.823968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1927.834507] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e583f7e5-364a-4a33-9784-9c313528bb3d in Status: IN_PROGRESS for 2s [ 1928.656230] env[61817]: INFO networking_nsxv3.common.synchronization [req-c11b35ca-5602-4786-a171-b11a20b401ee req-16839a93-1c4e-4b5c-aeb0-67f3c7f52453 tempest-ServerAddressesTestJSON-825595071 tempest-ServerAddressesTestJSON-825595071-project-member] Enqueued Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGHEST for action security_group_members [ 1928.656230] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGHEST for action security_group_members [ 1928.656230] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.656230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.656230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.656230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.656230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.656230] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.656230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.656230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.656230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.656230] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.656230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.656230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.656230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.656230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.656230] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1928.664723] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.664842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.664945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.665093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.665178] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.665352] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.665452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.665512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.665764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.665832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.666090] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f already deleted. [ 1928.666090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.930417] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.930749] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.930749] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.930996] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.931183] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.931444] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-391 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.931626] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-391" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.931751] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-391" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.932188] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-391" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.932449] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.932610] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.932731] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.932948] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.933093] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.933246] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-391" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.933492] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.933642] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.933757] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.933963] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.934096] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.934332] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-6bbbd2da-b17b-4f92-8721-41819ad2061b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.934487] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-6bbbd2da-b17b-4f92-8721-41819ad2061b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.934606] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-6bbbd2da-b17b-4f92-8721-41819ad2061b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.934857] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-6bbbd2da-b17b-4f92-8721-41819ad2061b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.934997] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bbbd2da-b17b-4f92-8721-41819ad2061b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1928.950065] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.950270] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.950426] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.950714] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.950862] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.951018] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 6bbbd2da-b17b-4f92-8721-41819ad2061b not found, creating... [ 1928.951351] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.951515] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.951635] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.951873] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.952032] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.952430] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.952596] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.952718] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.952931] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.953071] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.953214] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 6bbbd2da-b17b-4f92-8721-41819ad2061b is going to be created. [ 1928.976026] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1928.976026] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1928.976026] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1928.976284] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1928.976414] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1928.976659] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-6bbbd2da-b17b-4f92-8721-41819ad2061b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.192834] env[61817]: INFO networking_nsxv3.common.synchronization [req-c11b35ca-5602-4786-a171-b11a20b401ee req-7b10344a-552e-4fe7-bcfc-7521fc6a7cbb service neutron] Enqueued Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGHEST for action security_group_rules [ 1929.193032] env[61817]: INFO networking_nsxv3.common.synchronization [req-c11b35ca-5602-4786-a171-b11a20b401ee req-7b10344a-552e-4fe7-bcfc-7521fc6a7cbb service neutron] Enqueued Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGHEST for action security_group_members [ 1929.193180] env[61817]: INFO networking_nsxv3.common.synchronization [req-c11b35ca-5602-4786-a171-b11a20b401ee req-7b10344a-552e-4fe7-bcfc-7521fc6a7cbb service neutron] Enqueued Resource ID: 6bbbd2da-b17b-4f92-8721-41819ad2061b with Priority: HIGHEST for action port [ 1929.193412] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGHEST for action security_group_rules [ 1929.193532] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGHEST for action security_group_members [ 1929.193640] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bbbd2da-b17b-4f92-8721-41819ad2061b with Priority: HIGHEST for action port [ 1929.194529] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.194671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.194742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.194950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.195035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.195192] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.195296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.195359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.195556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.195637] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1929.198560] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.198560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.198560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.198560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.198560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.198560] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.198560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.198560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.198560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.198560] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.198560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.198560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.198560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.198560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.198560] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1929.198560] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.199233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.199233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.199233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.199233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.199233] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bbbd2da-b17b-4f92-8721-41819ad2061b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.199233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bbbd2da-b17b-4f92-8721-41819ad2061b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.199233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bbbd2da-b17b-4f92-8721-41819ad2061b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.199453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bbbd2da-b17b-4f92-8721-41819ad2061b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.199453] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bbbd2da-b17b-4f92-8721-41819ad2061b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1929.223897] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1929.239637] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bbbd2da-b17b-4f92-8721-41819ad2061b with status ACTIVE [ 1929.239637] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.239637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.239637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.239637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.239637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.239637] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.239637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.239637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.239637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.239637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.240263] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1929.242116] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.242303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.242405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.242616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.242735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.242923] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.243041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.247735] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.247933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.248057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.248272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.248422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.248541] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f is going to be created. [ 1929.293529] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.293803] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.293925] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.294209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.294476] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.305453] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f in Status: UNINITIALIZED for 2s [ 1929.708944] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.709277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.709400] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.709655] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.709800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.709942] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bbbd2da-b17b-4f92-8721-41819ad2061b is going to be updated. [ 1929.733116] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1929.733414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1929.733524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1929.733817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1929.734035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.734261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bbbd2da-b17b-4f92-8721-41819ad2061b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1929.844812] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e583f7e5-364a-4a33-9784-9c313528bb3d in Status: SUCCESS [ 1929.845073] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e583f7e5-364a-4a33-9784-9c313528bb3d deletion is rescheduled due to dependency. [ 1929.845227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.315211] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f in Status: SUCCESS [ 1931.315608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.315608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.315827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.316125] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.316249] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1931.316249] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.316418] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.316502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.316590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.316683] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1931.327392] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.327535] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1931.327608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.327755] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.327840] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.328011] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.328116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1931.328180] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.328329] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.328470] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.328562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1931.328622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.328758] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.328837] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.328918] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.329066] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.329157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1931.329219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.329406] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.329458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.329560] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.329649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1931.329708] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.329847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.329981] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.330069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1931.330130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.330264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.330339] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.330420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.330507] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1931.336803] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75f51202-796b-4ac3-a0b3-2893fc0c366f: rpc.has_security_group_logging(os_id): False [ 1931.353596] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.353748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1931.353793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.353972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.354059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.354246] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.354345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1931.354468] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.354552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.354628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.354829] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.354921] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1931.354983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.355123] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.355201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.355377] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.355469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1931.355544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.355665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.355738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.355823] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f is going to be created. [ 1931.417019] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1931.417231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1931.417278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1931.417515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1931.417717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1931.427815] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f in Status: IN_PROGRESS for 2s [ 1933.440439] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f in Status: SUCCESS [ 1933.440781] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1934.195186] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1934.195307] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1939.196313] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1939.196705] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1944.197552] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1944.197916] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1949.199266] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1949.199525] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1954.200860] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1954.201256] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1957.004231] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:5 completed [ 1957.004581] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:6 started [ 1959.202569] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1959.202569] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1961.828616] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1961.829043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1961.829043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1961.829043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1961.829193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1961.829275] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1961.829376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1961.829441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1961.829596] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1961.829701] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1961.838632] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1961.845125] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1961.851199] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1961.851293] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1962.466161] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.466324] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.466396] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.466616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.480166] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1962.480621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.481421] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1962.509776] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.509934] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.509997] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.510189] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.517408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.517905] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1962.517987] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1962.518074] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1962.541686] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.541887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.541887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.542084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.542665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.542800] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1962.582546] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.582722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.582766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.582956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.583174] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.583341] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1962.625000] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.625168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.625224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.625416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.625587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.625762] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:11. [ 1962.625842] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'75f51202-796b-4ac3-a0b3-2893fc0c366f', 'b1620446-f273-4658-baad-13a497dabc74', 'e583f7e5-364a-4a33-9784-9c313528bb3d', '3ffcb57e-8678-415b-bd13-19b60dbd45bd', '9f129921-ca53-4911-9bcc-7d661d45384d', '809c9d4c-eb3e-493d-bbfc-45d99fd37e44', '5a2644aa-f99a-4b14-9145-702ba5c8452b', '8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0', '434c81a0-40dd-4119-b850-8a8e4707a3f9', '8ccdfdda-5544-48a2-976b-b365f092bbb9', '5233168b-5f93-4bb0-bac2-dd279d965d46'} {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1962.625907] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1962.644296] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.644506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.644506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.644655] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.644739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.644850] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1962.644924] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1962.645150] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1962.686575] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.686777] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.686827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.687018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.687440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.687611] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1962.687690] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 1962.687762] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1962.687831] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1962.687911] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 11/11 resources of Type:Security Group Rules [ 1962.687984] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGH for action security_group_rules [ 1962.688102] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGH for action security_group_rules [ 1962.688176] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGH for action security_group_rules [ 1962.688241] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 1962.688303] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGH for action security_group_rules [ 1962.688364] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGH for action security_group_rules [ 1962.688425] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 1962.688486] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 1962.688546] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGH for action security_group_rules [ 1962.688607] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGH for action security_group_rules [ 1962.688668] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 1962.688737] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1962.688799] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1962.688982] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.689081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.689143] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.689293] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.689369] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.689547] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.689647] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.689738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.689883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.689957] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.690120] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.690210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.690269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.690403] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.690476] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.690636] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.690724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.690783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.690916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.690989] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.691215] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.691305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.691366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.691504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.691577] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.691739] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.691831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.691889] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.692037] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.692121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.692288] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.692381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.692440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.692986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.693085] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.693261] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.693355] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.693418] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.693560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.693635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.693798] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.693889] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.694142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.694303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.694381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.694552] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.694644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.694706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.694842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.694915] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.695077] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.695190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.695253] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.695392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.695467] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.695630] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.695739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.695804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.695944] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.696038] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.696204] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.696297] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.696357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.696491] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.696563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.696722] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.696813] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.696871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.697002] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.697075] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.697236] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.697325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.697383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.697515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.697586] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.697765] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.697892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.697955] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.698095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.698179] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.698344] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.698438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.698499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.698624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.698696] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.698899] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.698994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.699055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.699194] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.699268] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.699430] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.699521] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.699578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.699709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.699782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.699941] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.700045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.700107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.700245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.700317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.700476] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.700565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.700624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.700758] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.700830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.700987] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.701078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.701156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.701300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.701374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.701534] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.701623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.701682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.701838] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.701914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.702091] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.702188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.702248] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.702407] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.702484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.702647] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.702736] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.702796] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.702933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.703004] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.703163] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.703252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.703311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.703446] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.703517] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.703623] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 1962.703686] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 1962.703753] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1962.745528] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1030 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.745726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.745726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.745914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.746131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.746301] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1962.784711] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1031 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1962.784911] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1962.784911] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1962.785115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1962.785312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1962.798361] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 1962.798515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.203368] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1964.203804] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=12], Jobs=0 [ 1964.203804] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGH for action security_group_rules [ 1964.203804] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGH for action security_group_rules [ 1964.203804] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 1964.203970] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 1964.204021] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 1964.204103] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGH for action security_group_rules [ 1964.204202] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGH for action security_group_rules [ 1964.204852] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGH for action security_group_rules [ 1964.204988] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 1964.205196] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGH for action security_group_rules [ 1964.205309] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGH for action security_group_rules [ 1964.205410] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 1964.205765] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.205897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.205994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.206174] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.206357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.206525] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.206630] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.206693] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.206869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.206943] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.208469] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.208584] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.208652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.208941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.209022] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.209167] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.209262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.209323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.209466] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.209540] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.210810] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.210923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.210990] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.211166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.211250] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.211395] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.211488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.211550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.211692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.211763] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.213859] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.213973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.214041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.214192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.214269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.214408] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.214502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.214565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.214706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.214966] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.216159] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.216282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.216473] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.216582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.216659] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.216799] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.216892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.216952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.217091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.217161] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.218105] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.218215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.218281] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.218428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.218505] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.218640] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.218730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.218789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.218922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.218998] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.220042] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.220161] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.220230] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.220513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.220599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.220824] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.220929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.220991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.221165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.221233] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.222127] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.222246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.222316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.222472] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.222549] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.222688] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.222782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.222843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.222986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.223056] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.223771] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.223875] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.223943] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.224103] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.224182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.224327] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.224420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.224482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.224638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.224708] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.225388] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.225498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.225565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.225714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.225789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.225929] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.226043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.226105] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.226260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.226329] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.227109] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.227221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.227287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.227468] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.227518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.227645] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.227737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.227799] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.227935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.228011] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.266034] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.266232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.266232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.266440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.266529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.266687] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.266782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.266844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.266988] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.267129] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.267226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.267304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.267452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.267530] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.267611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.267695] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.268960] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.269086] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.269157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.269307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.269383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.269525] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.269615] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.269675] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.269813] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.269944] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.270034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.270095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.270228] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.270358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.270489] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.270577] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.272535] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.272646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.272715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.272866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.272961] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.274550] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.274550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.274550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.274550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.274550] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.274550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.274550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.274550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.274550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.274550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.274550] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.276272] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.276404] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.276440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.276587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.278022] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.278166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.278222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.278395] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.278465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.278612] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.278706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.278769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.278910] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.279075] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.279151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.279323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.279475] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.279552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.279634] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.279711] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.284704] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.284876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.284983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.285189] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.285318] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.285510] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.285652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.285753] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.285941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.286127] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.286280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.286381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.286594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.286709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.286830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.287020] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.287159] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.287259] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.287440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.287568] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.287749] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.287886] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.287984] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.288184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.288366] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.288504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.288603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.288781] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.288908] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.289029] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.289182] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.292609] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.292776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.292886] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.293079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.293207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.293394] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.293546] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.293646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.293831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.294016] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.294155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.294257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.294494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.294572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.294693] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.294821] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.296272] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.296425] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.297416] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.297582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.297690] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.297893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.298019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.298207] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.298567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.298567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.298567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.298767] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.298904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.299001] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.299215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.299345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.299470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.299657] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.299794] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.299890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.300286] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.300286] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.300286] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.300588] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.300691] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.300874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.301053] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.301213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.301315] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.301499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.301638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.301757] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.301895] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.302703] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.302865] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.302971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.303159] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.303286] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.303473] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.303612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.303711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.303905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.304102] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.304245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.304342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.304521] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.304642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.304762] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.304948] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.305085] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.305192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.305370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.305485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.305866] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.306036] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.306142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.306330] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.306515] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.306679] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.306761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.306940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.307059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.307184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.307304] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.308797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.308974] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e583f7e5-364a-4a33-9784-9c313528bb3d is going to be deleted. [ 1964.310984] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.311169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.311295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.311504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.311617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.311803] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.311945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.312061] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.312322] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.312456] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.312688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.312812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.312995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.313117] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.313241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.313446] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.313611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.313701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.313883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.313998] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.314178] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.314347] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.314443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.314622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.314802] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.314939] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.315037] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.315217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.315339] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.315468] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.315587] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.316291] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.316524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.317636] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5233168b-5f93-4bb0-bac2-dd279d965d46: rpc.has_security_group_logging(os_id): False [ 1964.320471] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0: rpc.has_security_group_logging(os_id): False [ 1964.321736] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ccdfdda-5544-48a2-976b-b365f092bbb9: rpc.has_security_group_logging(os_id): False [ 1964.325084] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.325273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.325396] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.325610] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.325740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.325936] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.326079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.326182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.326370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.326566] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.326709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.326819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.327002] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.327127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.327253] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.327447] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.327587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.327685] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.327866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.327982] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.328198] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.328327] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.328428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.328607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.329045] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.329045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.329045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.329375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.329375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.329375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.329504] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.332909] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a2644aa-f99a-4b14-9145-702ba5c8452b: rpc.has_security_group_logging(os_id): False [ 1964.334112] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.334285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.334395] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.334601] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.334732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.334922] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.335080] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.335203] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.335388] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.335578] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.335720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.335820] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.336008] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.336147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.336276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.336403] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.340898] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.341122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.341246] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.341458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.341951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.342196] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.342363] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.342470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.342673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.342870] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.343251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.343667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.343881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.344060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.344171] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.344311] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.346452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.346613] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1620446-f273-4658-baad-13a497dabc74 is going to be deleted. [ 1964.354092] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75f51202-796b-4ac3-a0b3-2893fc0c366f: rpc.has_security_group_logging(os_id): False [ 1964.359432] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.359674] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.359841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.360131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.360277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.360490] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.360657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.360761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.360956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.361197] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.361349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.361452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.361636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.361764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.362767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.362767] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.362767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.362767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.362767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.362767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.362767] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.362767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.362767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.363084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.363820] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.363934] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.364010] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.364182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.364265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.364353] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.364445] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.365777] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.365892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.365961] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.366256] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.366256] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.366331] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.366408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.366493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.366598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.366735] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.366828] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.366889] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.367056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.367151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.367237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.367388] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.367482] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.367541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.367682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.367755] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.367892] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.367982] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.368094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.368197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.368330] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.368417] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.368480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.368612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.368687] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.368765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.368852] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.369708] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.369804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.369876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.370024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.370103] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.370246] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.370339] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.370438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.370537] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.371095] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.371095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.371095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.371095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.371095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.371095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.371307] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.373017] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.373133] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.373240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.373362] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.376213] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.376306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.377099] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.377197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.378232] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.378333] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.389089] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 809c9d4c-eb3e-493d-bbfc-45d99fd37e44: rpc.has_security_group_logging(os_id): False [ 1964.390172] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 434c81a0-40dd-4119-b850-8a8e4707a3f9: rpc.has_security_group_logging(os_id): False [ 1964.397074] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.397279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.397279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.397473] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.397557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.397714] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.397831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.397880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.398015] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.398155] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.398242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.398292] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.398435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.398513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.398595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.398744] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.398831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.398885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.399044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.399125] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.399268] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.399359] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.399415] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.399552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.399689] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.399767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.399828] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.399962] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.400055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.400132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.400222] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1964.406550] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ffcb57e-8678-415b-bd13-19b60dbd45bd: rpc.has_security_group_logging(os_id): False [ 1964.408260] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.408368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.410080] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.410173] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.410947] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.411043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.412170] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.412260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.421905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.422197] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.422358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.422402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.422718] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.422809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.423050] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.423159] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.423227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.423428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.423503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.423750] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.423877] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.423948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.424173] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.424257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.424357] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 1964.425543] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.425708] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.429687] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.429812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.430604] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.430697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.441261] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.441472] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.449899] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.450144] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.450262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.450327] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.450525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.450607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.450809] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.450908] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.450971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.451154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.451233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.451423] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.451513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.451583] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.451727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.451804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.451896] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 is going to be updated. [ 1964.453228] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.453501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.489849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.490164] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.490294] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.490363] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.490567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.490652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.490844] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.490944] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.491007] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.491205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.491281] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.491466] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.491538] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.491602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.491742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.491818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.491911] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 1964.493097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.493267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.529733] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.530036] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.530166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.530234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.530445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.530528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.530732] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.530829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.530878] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.531028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.531160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.531353] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.531426] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.531490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.531631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.531705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.531800] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 is going to be updated. [ 1964.533037] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.533204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.559865] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.560082] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.577197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.577471] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.577599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.577666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.577866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.577948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.578159] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.578260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.578322] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.578470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.578547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.578719] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.578800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.578861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.579002] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.579076] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.579172] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f is going to be updated. [ 1964.581188] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.581282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.581349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.581505] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.581645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.582704] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.582871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.720244] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.720511] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.721602] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.721841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.736421] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1964.749123] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.749691] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.749973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.750139] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.750464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.750658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.750973] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.751239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.751408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.751682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.751970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.752401] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.752634] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.752788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.753041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.753207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.753390] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 is going to be updated. [ 1964.754739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.755041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.755233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.755453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.755695] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.755949] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.783355] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.783724] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f129921-ca53-4911-9bcc-7d661d45384d is going to be deleted. [ 1964.784894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.785225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.785487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.786587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.786875] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.814644] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 in Status: IN_PROGRESS for 2s [ 1964.816023] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.816458] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.816739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.816907] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.817198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.817386] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.817727] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.817965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.818116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.818416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.818611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.818941] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.819195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.819378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.819645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.819832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.820043] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be updated. [ 1964.821368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.821661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.821850] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.822071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.822337] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.822594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.822835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.824875] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.825120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.825282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.825545] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.825781] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.826853] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.827124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.827364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.828398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.828743] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.848538] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 in Status: IN_PROGRESS for 2s [ 1964.849697] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f in Status: IN_PROGRESS for 2s [ 1964.853801] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 1964.856097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.856489] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.856746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.856907] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.857195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.857404] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.857708] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.857929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.858082] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.858342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.858514] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.858811] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.859027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.859183] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.859426] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.859602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.859790] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1964.905352] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.905860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.906038] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.906351] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.906661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.906890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.925750] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.926208] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.926387] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.926695] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.926952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.941243] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 in Status: IN_PROGRESS for 2s [ 1964.951541] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.951953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.952178] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.952508] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.952800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1964.981354] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1964.981802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1964.981974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1964.982375] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1964.982656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1965.001286] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 1965.009869] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1966.752474] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1966.752787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1966.828014] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 in Status: SUCCESS [ 1966.828251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1966.866608] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 in Status: SUCCESS [ 1966.866831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1966.867625] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 1966.867793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1966.868406] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f in Status: SUCCESS [ 1966.868574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1966.954262] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 in Status: SUCCESS [ 1966.954453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1967.013026] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 1967.013270] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1967.019772] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1967.019979] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1969.206881] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1969.207168] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1974.208040] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1974.208398] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1977.590164] env[61817]: INFO networking_nsxv3.common.synchronization [req-54b434c0-87a4-4acf-9495-f33d6d936275 req-e3b35000-a4c0-4478-b0cc-181a593f82f7 tempest-DeleteServersTestJSON-1745478556 tempest-DeleteServersTestJSON-1745478556-project-member] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1977.590819] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 1977.591327] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1977.591453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1977.591667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1977.591667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1977.591903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1977.591903] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1977.592148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1977.592148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1977.592369] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1977.592539] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1977.592539] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1977.592539] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1977.592726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1977.592950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1977.592950] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1977.601708] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1977.612757] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1977.619291] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1977.619400] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1977.619459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1977.619636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1977.619727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1977.619823] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 1977.655369] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1977.655529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1977.655601] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1977.655801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1977.655950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1977.665686] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 1979.676243] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 1979.676621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1982.592080] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1982.592457] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1984.972626] env[61817]: INFO networking_nsxv3.common.synchronization [req-7d875463-400a-4752-8f42-613d12e23133 req-cba66f44-5e30-479e-8b73-ba63bed8c5d5 tempest-ServerDiskConfigTestJSON-1489146392 tempest-ServerDiskConfigTestJSON-1489146392-project-member] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1984.973002] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1984.973320] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.973435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.973498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.973691] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.973771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.973924] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.974015] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.974071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.974214] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.974343] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1984.974449] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1984.974479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1984.974859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1984.974859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1984.974859] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1984.983448] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1984.993349] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1985.002255] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.002531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.002655] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.002930] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.003077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.003217] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1985.040748] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.040748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.040748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.040748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.040748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.053254] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1985.305616] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.305827] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.305959] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.306228] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.306379] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.306640] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-72 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.306794] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.306912] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.307128] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.307371] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.307524] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.307641] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.307843] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.307978] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.308132] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-72" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.308384] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.308537] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.308656] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.308861] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.308999] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.309303] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-45b96ccf-14b6-463c-8240-f354320958bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.309489] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-45b96ccf-14b6-463c-8240-f354320958bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.309613] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-45b96ccf-14b6-463c-8240-f354320958bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.309878] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-45b96ccf-14b6-463c-8240-f354320958bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.310020] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45b96ccf-14b6-463c-8240-f354320958bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1985.324283] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.324476] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.324603] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.324842] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.324984] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.325130] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 45b96ccf-14b6-463c-8240-f354320958bd not found, creating... [ 1985.325381] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.325528] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.325643] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.325851] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.325988] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.326273] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.326420] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.326536] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.326738] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.326874] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.327012] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 45b96ccf-14b6-463c-8240-f354320958bd is going to be created. [ 1985.351184] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.351184] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.351376] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.351505] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.351744] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.351982] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-45b96ccf-14b6-463c-8240-f354320958bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.586511] env[61817]: INFO networking_nsxv3.common.synchronization [req-7d875463-400a-4752-8f42-613d12e23133 req-8331d173-a6d7-4b8b-9ed1-0fc8bef65c39 service neutron] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_rules [ 1985.586688] env[61817]: INFO networking_nsxv3.common.synchronization [req-7d875463-400a-4752-8f42-613d12e23133 req-8331d173-a6d7-4b8b-9ed1-0fc8bef65c39 service neutron] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1985.586826] env[61817]: INFO networking_nsxv3.common.synchronization [req-7d875463-400a-4752-8f42-613d12e23133 req-8331d173-a6d7-4b8b-9ed1-0fc8bef65c39 service neutron] Enqueued Resource ID: 45b96ccf-14b6-463c-8240-f354320958bd with Priority: HIGHEST for action port [ 1985.587050] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_rules [ 1985.587190] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 1985.587285] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45b96ccf-14b6-463c-8240-f354320958bd with Priority: HIGHEST for action port [ 1985.587838] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.587965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.588047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.588242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.588338] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.588509] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.588604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.588723] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.588810] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.588882] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1985.589741] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.589834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.589900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.590100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.590175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.590313] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.590387] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.590833] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.590957] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.591020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.591187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.591262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.591398] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-45b96ccf-14b6-463c-8240-f354320958bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.591479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45b96ccf-14b6-463c-8240-f354320958bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.591537] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45b96ccf-14b6-463c-8240-f354320958bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.591673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45b96ccf-14b6-463c-8240-f354320958bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.591772] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45b96ccf-14b6-463c-8240-f354320958bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1985.604279] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.604474] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.604474] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.604688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.604770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.604934] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.605056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.614602] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45b96ccf-14b6-463c-8240-f354320958bd with status ACTIVE [ 1985.614811] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.614970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.615039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.615241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.615328] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.615504] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.615624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.615682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.615833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.615907] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.991427] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1985.991847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1985.991847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1985.991847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1985.991952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1985.992041] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45b96ccf-14b6-463c-8240-f354320958bd is going to be updated. [ 1986.014280] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1986.014497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1986.014541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1986.014768] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1986.014941] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1986.015153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45b96ccf-14b6-463c-8240-f354320958bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1987.062716] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1987.063103] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1987.063103] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1987.063312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1987.063506] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1987.063656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1987.063729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1987.063896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1987.063988] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1987.064083] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1987.072395] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1987.080338] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1987.086833] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1987.086973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1987.087041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1987.087265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1987.087385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1987.087484] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1987.115996] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1987.116185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1987.116257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1987.116481] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1987.116631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1987.125809] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1989.139956] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1989.140321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.140357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.140574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.140774] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.140894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.140961] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.141145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.141252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.141300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.141415] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1989.150615] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.150768] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.150807] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.150975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.151056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.151243] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.151345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.151412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.151551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.151691] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.151783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.151845] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.151976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.152075] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.152156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.152305] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.152398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.152469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.152593] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.152666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.152805] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.152897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.152956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.153093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.153228] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.153316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.153369] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.153536] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.153617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.153699] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.153785] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1989.160058] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5233168b-5f93-4bb0-bac2-dd279d965d46: rpc.has_security_group_logging(os_id): False [ 1989.185793] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.186175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.186382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.186666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.186813] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.187066] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.187220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.187342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.187556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.187767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.188047] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.188203] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.188310] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.188503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.188629] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.188875] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.189043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.189142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.189332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.189458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.189581] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 1989.246807] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1989.247090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 1989.247253] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 1989.247505] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 1989.247711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1989.261938] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 1990.588830] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1990.588830] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1991.276419] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 1991.276603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 1995.589615] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1995.589615] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2000.590750] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2000.591120] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2005.591751] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2005.592180] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2010.592664] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2010.593039] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2015.594174] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2015.594706] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2020.595462] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2020.595858] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2025.596568] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2025.596946] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2027.997574] env[61817]: INFO networking_nsxv3.common.synchronization [req-aeb1acbf-26da-4ebc-9565-e513c4168e3e req-ba1d2058-5ff2-40c6-8ab8-9a0edb622ebf tempest-ServerRescueNegativeTestJSON-901351471 tempest-ServerRescueNegativeTestJSON-901351471-project-member] Enqueued Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGHEST for action security_group_members [ 2027.998097] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGHEST for action security_group_members [ 2027.998407] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.998533] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2027.998602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2027.998798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2027.998882] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2027.999041] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.999131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2027.999179] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2027.999329] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2027.999467] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2027.999557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2027.999929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2027.999929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2027.999929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2027.999929] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2028.009038] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2028.009184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2028.009232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2028.009398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2028.009487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2028.009827] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2028.009827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2028.009827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2028.009969] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2028.010057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2028.010278] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 is going to be updated. [ 2028.047805] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2028.047971] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2028.048060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2028.048272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2028.048421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2028.057676] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 in Status: IN_PROGRESS for 2s [ 2029.110570] env[61817]: INFO networking_nsxv3.common.synchronization [req-d09e6d4f-cbd3-4252-902d-e7d55d94847f req-01a007a8-c39c-4cb1-b588-ddbf8382389d tempest-ImagesTestJSON-1042540315 tempest-ImagesTestJSON-1042540315-project-member] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2029.111054] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2029.111506] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.111646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.111718] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.111945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.112049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.112253] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.112356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.112433] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.112605] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.112757] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.112857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.112916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.113060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.113140] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.113224] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2029.121238] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2029.129193] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2029.138301] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.138454] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.138505] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.138708] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.138798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.138892] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 2029.171439] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.171655] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.171655] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.171836] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.171987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.180822] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 2029.440880] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.441098] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.441299] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.441574] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.441722] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.441981] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-16 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.442158] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.442291] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.442524] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.442779] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.442935] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.443050] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.443255] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.443529] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.443714] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.443966] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.444138] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.444262] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.444471] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.444609] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.444860] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-ab9d1411-8c68-4ab7-971d-7959c7c85a5b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.445016] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-ab9d1411-8c68-4ab7-971d-7959c7c85a5b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.445135] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-ab9d1411-8c68-4ab7-971d-7959c7c85a5b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.445404] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-ab9d1411-8c68-4ab7-971d-7959c7c85a5b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.445543] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab9d1411-8c68-4ab7-971d-7959c7c85a5b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2029.460643] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.460856] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.460987] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.461338] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.461516] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.461686] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port ab9d1411-8c68-4ab7-971d-7959c7c85a5b not found, creating... [ 2029.461949] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.462123] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.462268] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.462495] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.462643] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.462936] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.463094] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.463214] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.463445] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.463573] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.463718] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: ab9d1411-8c68-4ab7-971d-7959c7c85a5b is going to be created. [ 2029.484924] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.485164] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.485254] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.485526] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.485761] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.485980] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-ab9d1411-8c68-4ab7-971d-7959c7c85a5b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.707261] env[61817]: INFO networking_nsxv3.common.synchronization [req-d09e6d4f-cbd3-4252-902d-e7d55d94847f req-cf44144e-0c81-432a-9369-035b4ef45afa service neutron] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_rules [ 2029.707430] env[61817]: INFO networking_nsxv3.common.synchronization [req-d09e6d4f-cbd3-4252-902d-e7d55d94847f req-cf44144e-0c81-432a-9369-035b4ef45afa service neutron] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2029.707569] env[61817]: INFO networking_nsxv3.common.synchronization [req-d09e6d4f-cbd3-4252-902d-e7d55d94847f req-cf44144e-0c81-432a-9369-035b4ef45afa service neutron] Enqueued Resource ID: ab9d1411-8c68-4ab7-971d-7959c7c85a5b with Priority: HIGHEST for action port [ 2029.708173] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_rules [ 2029.708304] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2029.708398] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab9d1411-8c68-4ab7-971d-7959c7c85a5b with Priority: HIGHEST for action port [ 2029.708910] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.709034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.709100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.709326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.709433] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.709592] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.709688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.709747] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.709920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.710008] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2029.710984] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.711101] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.711245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.711409] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.711486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.711633] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.711709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.711904] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.711996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.712072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.712367] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.712456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.712609] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab9d1411-8c68-4ab7-971d-7959c7c85a5b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.712707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab9d1411-8c68-4ab7-971d-7959c7c85a5b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.712771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab9d1411-8c68-4ab7-971d-7959c7c85a5b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.712914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab9d1411-8c68-4ab7-971d-7959c7c85a5b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.713020] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab9d1411-8c68-4ab7-971d-7959c7c85a5b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2029.729867] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.730007] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.730065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.730261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.730399] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.730985] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.731083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.745889] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab9d1411-8c68-4ab7-971d-7959c7c85a5b with status ACTIVE [ 2029.746224] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.746436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.746587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.746784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.746879] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2029.747095] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2029.747155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2029.747193] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2029.747335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2029.747449] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2030.075145] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 in Status: SUCCESS [ 2030.075203] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 deletion is rescheduled due to dependency. [ 2030.075449] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2030.143673] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2030.144093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2030.144093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2030.144093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2030.144203] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2030.144295] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab9d1411-8c68-4ab7-971d-7959c7c85a5b is going to be updated. [ 2030.166435] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2030.166662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2030.166662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2030.166848] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2030.166984] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2030.167143] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab9d1411-8c68-4ab7-971d-7959c7c85a5b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2031.189957] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 2031.190350] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2031.190350] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2031.190516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2031.190699] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2031.190816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2031.190880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2031.191036] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2031.191139] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2031.191232] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2031.199051] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2031.206111] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2031.212505] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2031.212637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2031.212707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2031.212897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2031.212984] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2031.213077] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 2031.241554] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2031.241768] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2031.241768] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2031.241965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2031.242120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2031.252033] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 2033.264863] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 2033.265155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.265240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.265462] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.265661] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2033.265779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2033.265845] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.266000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.266082] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.266168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.266260] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2033.275266] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2033.275401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2033.275463] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.275646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.275731] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.275887] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2033.275983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2033.276057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.276207] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.276356] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2033.276452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2033.276513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.276652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.276730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.276812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.276960] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2033.277052] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2033.277114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.277254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.277324] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.277483] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2033.277588] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2033.277650] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.277876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.278017] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2033.278156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2033.278231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.278374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.278447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.278529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.278616] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2033.284778] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a2644aa-f99a-4b14-9145-702ba5c8452b: rpc.has_security_group_logging(os_id): False [ 2033.303291] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2033.303474] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2033.303520] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.303695] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.303784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.304056] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2033.304144] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2033.304264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.304417] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.304450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.304684] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2033.304767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2033.304798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.304916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.304993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.305186] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2033.305292] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2033.305353] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.305522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.305575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.305647] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 2033.368480] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2033.368700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2033.368700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2033.368891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2033.369048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2033.383020] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 2034.709748] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2034.710096] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2035.397908] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 2035.398240] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2039.710549] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2039.710994] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2044.712230] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2044.712515] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2049.713040] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2049.713394] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2054.714235] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2054.714561] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2059.715186] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2059.715646] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2064.716374] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2064.716713] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2069.036717] env[61817]: INFO networking_nsxv3.common.synchronization [req-54744886-2bc9-4d76-b404-41b434ab369e req-c7d07e9c-4875-40b9-93c5-556156bb17ab tempest-ServersTestJSON-1722207346 tempest-ServersTestJSON-1722207346-project-member] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 2069.037268] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 2069.037595] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.037720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.037872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.037992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.038079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.038232] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.038336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.038400] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.038552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.038690] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.038782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.038842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.038978] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.039219] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.039336] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.053704] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.062125] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.068611] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.068766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.068854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.069116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.069215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.069312] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be updated. [ 2069.101343] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.101495] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.101556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.101739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.101883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.111806] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 2069.361784] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.361984] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.362117] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.362417] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.362581] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.362841] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-463 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.363000] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.363121] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.363690] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.363950] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.364133] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.364260] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.364475] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.364619] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.364770] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-463" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.365019] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.365174] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.365295] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.365527] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.365677] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.365919] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-8e860d11-eedf-4814-b317-e4a4afb9eed2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.366074] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-8e860d11-eedf-4814-b317-e4a4afb9eed2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.366193] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-8e860d11-eedf-4814-b317-e4a4afb9eed2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.366458] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-8e860d11-eedf-4814-b317-e4a4afb9eed2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.366599] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e860d11-eedf-4814-b317-e4a4afb9eed2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.380955] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.381149] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.381284] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.381524] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.381674] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.381825] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 8e860d11-eedf-4814-b317-e4a4afb9eed2 not found, creating... [ 2069.382074] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.382243] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.382378] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.382600] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.382741] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.383028] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.383191] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.383311] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.383531] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.383668] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.383812] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 8e860d11-eedf-4814-b317-e4a4afb9eed2 is going to be created. [ 2069.403156] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.403405] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.403567] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.403832] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.404084] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.404311] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-8e860d11-eedf-4814-b317-e4a4afb9eed2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.624519] env[61817]: INFO networking_nsxv3.common.synchronization [req-54744886-2bc9-4d76-b404-41b434ab369e req-977b6e6f-3aa4-4bb1-8858-77e7a6a217a4 service neutron] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_rules [ 2069.624703] env[61817]: INFO networking_nsxv3.common.synchronization [req-54744886-2bc9-4d76-b404-41b434ab369e req-977b6e6f-3aa4-4bb1-8858-77e7a6a217a4 service neutron] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 2069.624982] env[61817]: INFO networking_nsxv3.common.synchronization [req-54744886-2bc9-4d76-b404-41b434ab369e req-977b6e6f-3aa4-4bb1-8858-77e7a6a217a4 service neutron] Enqueued Resource ID: 8e860d11-eedf-4814-b317-e4a4afb9eed2 with Priority: HIGHEST for action port [ 2069.625319] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_rules [ 2069.625507] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 2069.625613] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e860d11-eedf-4814-b317-e4a4afb9eed2 with Priority: HIGHEST for action port [ 2069.626276] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.626347] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.626402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.626643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.626680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.626864] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.626966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.627035] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.627205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.627288] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.628620] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.628713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.628713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.628853] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.628924] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.629067] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.629480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.634590] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.634590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.634590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.634590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.634590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.634590] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e860d11-eedf-4814-b317-e4a4afb9eed2 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.634590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e860d11-eedf-4814-b317-e4a4afb9eed2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.634590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e860d11-eedf-4814-b317-e4a4afb9eed2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.634590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e860d11-eedf-4814-b317-e4a4afb9eed2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.634590] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e860d11-eedf-4814-b317-e4a4afb9eed2',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2069.651418] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e860d11-eedf-4814-b317-e4a4afb9eed2 with status ACTIVE [ 2069.651622] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.651749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.651820] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.652171] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.652171] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.652315] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.652423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.652488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.652638] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.652718] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.654472] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.654590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2069.654642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2069.654766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2069.654848] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2069.654995] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2069.655079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2070.160156] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.160156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2070.160156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2070.160716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2070.160716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2070.160716] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e860d11-eedf-4814-b317-e4a4afb9eed2 is going to be updated. [ 2070.248262] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2070.248574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2070.248655] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2070.249014] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2070.249249] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2070.249444] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e860d11-eedf-4814-b317-e4a4afb9eed2" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2071.122714] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 2071.122932] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2071.123102] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2071.123315] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2071.123546] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2071.123674] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2071.123674] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2071.123829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2071.123906] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2071.123998] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2071.132067] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2071.142182] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2071.149174] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2071.149353] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2071.149457] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2071.149700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2071.149810] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2071.149937] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be updated. [ 2071.178224] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2071.178580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2071.178580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2071.178907] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2071.179168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2071.188165] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 2073.199187] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 2073.199582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.199582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.199805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.199987] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.200121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2073.200184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.200335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.200416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.200500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.200592] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2073.208884] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.209013] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2073.209092] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.209269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.209354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.209514] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.209612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2073.209677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.209816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.209955] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.210044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2073.210098] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.210232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.210309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.210388] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.210533] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.210621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2073.210679] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.210806] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.210876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.211011] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.211097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2073.211178] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.211325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.211460] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.211548] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2073.211600] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.211733] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.211806] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.211883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.211966] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2073.217795] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ffcb57e-8678-415b-bd13-19b60dbd45bd: rpc.has_security_group_logging(os_id): False [ 2073.235498] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.235739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2073.235739] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.235894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.235984] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.236202] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.236348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2073.236422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.236582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.236663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.236876] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.237018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2073.237087] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.237167] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.237280] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.237452] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.237639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2073.237639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.237758] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.237809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.237880] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be updated. [ 2073.300492] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2073.300713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2073.300713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2073.300908] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2073.301059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2073.315320] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 2074.626988] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2074.626988] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2075.329575] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 2075.329771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2078.185833] env[61817]: INFO networking_nsxv3.common.synchronization [req-db473365-0f04-40ef-aaa0-66e555ff696f req-c503e371-c8b9-498b-b9ff-14acbcac44dc tempest-MultipleCreateTestJSON-1001388970 tempest-MultipleCreateTestJSON-1001388970-project-member] Enqueued Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGHEST for action security_group_members [ 2078.186351] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGHEST for action security_group_members [ 2078.186678] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2078.186788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2078.186856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2078.187095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2078.187146] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2078.187297] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2078.187394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2078.187458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2078.187606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2078.187753] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2078.187845] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2078.187906] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2078.188067] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2078.188149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2078.188240] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2078.199532] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2078.199692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2078.199729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2078.199913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2078.200013] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2078.200202] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2078.200412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2078.200481] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2078.200632] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2078.200713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2078.200879] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 is going to be updated. [ 2078.230065] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2078.230214] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2078.230262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2078.230469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2078.230815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2078.240440] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 in Status: IN_PROGRESS for 2s [ 2079.419125] env[61817]: INFO networking_nsxv3.common.synchronization [req-c86db6a8-e4a6-45e3-b0b1-e144de7a0459 req-bb1017a0-397f-42bd-9930-7bc27705c2ea tempest-DeleteServersTestJSON-1745478556 tempest-DeleteServersTestJSON-1745478556-project-member] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2079.419654] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2079.419929] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.420065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.420140] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.420331] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.420442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.420594] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.420714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.420790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.420980] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.421104] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.421423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.421506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.421706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.421803] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.421925] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2079.438340] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2079.453705] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2079.461780] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.461931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.462468] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.462468] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.462468] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.462468] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 2079.496231] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.496231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.496231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.496231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.496231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.507660] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 2079.721309] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.721536] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.721670] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.721935] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.722085] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.722351] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-455 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.722509] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.722631] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.722853] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.723102] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.723253] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.723375] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.723590] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.723723] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.723872] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.724143] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.724304] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.724424] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.724631] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.724769] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.725008] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-7c9939e9-a11a-441c-b322-8a22016e0ae4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.725165] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-7c9939e9-a11a-441c-b322-8a22016e0ae4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.725287] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-7c9939e9-a11a-441c-b322-8a22016e0ae4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.725549] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-7c9939e9-a11a-441c-b322-8a22016e0ae4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.725690] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c9939e9-a11a-441c-b322-8a22016e0ae4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2079.740071] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.740230] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.740355] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.740606] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.740762] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.740913] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 7c9939e9-a11a-441c-b322-8a22016e0ae4 not found, creating... [ 2079.741243] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.741407] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.741526] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.741742] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.741880] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.742242] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.742402] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.742520] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.742727] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.742864] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.743005] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 7c9939e9-a11a-441c-b322-8a22016e0ae4 is going to be created. [ 2079.764380] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.764595] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.764718] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.764998] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.765235] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.765468] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-7c9939e9-a11a-441c-b322-8a22016e0ae4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.977690] env[61817]: INFO networking_nsxv3.common.synchronization [req-c86db6a8-e4a6-45e3-b0b1-e144de7a0459 req-e47064c9-9bd9-4fbe-b071-2cabe0a638b2 service neutron] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_rules [ 2079.977969] env[61817]: INFO networking_nsxv3.common.synchronization [req-c86db6a8-e4a6-45e3-b0b1-e144de7a0459 req-e47064c9-9bd9-4fbe-b071-2cabe0a638b2 service neutron] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2079.978189] env[61817]: INFO networking_nsxv3.common.synchronization [req-c86db6a8-e4a6-45e3-b0b1-e144de7a0459 req-e47064c9-9bd9-4fbe-b071-2cabe0a638b2 service neutron] Enqueued Resource ID: 7c9939e9-a11a-441c-b322-8a22016e0ae4 with Priority: HIGHEST for action port [ 2079.978479] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_rules [ 2079.978662] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2079.978826] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9939e9-a11a-441c-b322-8a22016e0ae4 with Priority: HIGHEST for action port [ 2079.979478] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.979681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.979779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.980043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.980179] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.980393] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.980545] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.980697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.980874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.980993] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2079.982033] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.982157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.982284] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.982494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.982621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.982819] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.991409] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.991728] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.991957] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.991957] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.992168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.992247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2079.992365] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c9939e9-a11a-441c-b322-8a22016e0ae4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2079.992488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c9939e9-a11a-441c-b322-8a22016e0ae4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2079.992587] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c9939e9-a11a-441c-b322-8a22016e0ae4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2079.992881] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c9939e9-a11a-441c-b322-8a22016e0ae4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2079.992974] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c9939e9-a11a-441c-b322-8a22016e0ae4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2080.011946] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2080.011946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2080.011946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2080.012163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2080.012163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2080.012327] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2080.012386] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2080.016283] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c9939e9-a11a-441c-b322-8a22016e0ae4 with status ACTIVE [ 2080.016483] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2080.016608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2080.016677] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2080.016918] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2080.017038] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2080.017190] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2080.017285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2080.017347] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2080.017503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2080.017581] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2080.463248] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2080.463657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2080.463657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2080.463733] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2080.463800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2080.463896] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c9939e9-a11a-441c-b322-8a22016e0ae4 is going to be updated. [ 2080.483925] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2080.484238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2080.484344] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2080.484594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2080.484809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2080.485068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c9939e9-a11a-441c-b322-8a22016e0ae4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2081.073756] env[61817]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function GET Argumetns {'path': '/policy/api/v1/infra/realized-state/status', 'params': {'intent_path': '/infra/domains/default/groups/809c9d4c-eb3e-493d-bbfc-45d99fd37e44'}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 2081.073973] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=61817) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:126}} [ 2081.524306] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 2081.524707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2081.524707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2081.524901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2081.525086] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2081.525210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2081.525278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2081.525440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2081.525532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2081.525619] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2081.533712] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2081.540648] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2081.546588] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2081.546711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2081.546781] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2081.546963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2081.547052] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2081.547147] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 2081.575735] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2081.575963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2081.575963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2081.576177] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2081.576331] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2081.584355] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 2083.083346] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 in Status: SUCCESS [ 2083.083683] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 deletion is rescheduled due to dependency. [ 2083.083683] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.597603] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 2083.597826] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.598044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.598273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.598498] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.598628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2083.598695] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.598868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.598953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.599049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.599137] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2083.608154] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.608279] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2083.608349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.608554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.608654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.608818] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.608919] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2083.608983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.609148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.609292] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.609387] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2083.609451] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.609592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.609671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.609753] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.609908] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.610018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2083.610081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.610224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.610321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.610474] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.610593] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2083.610658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.610802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.610940] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.611031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2083.611091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.611255] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.611335] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.611417] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.611501] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2083.617089] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0: rpc.has_security_group_logging(os_id): False [ 2083.637447] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.637604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2083.637646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.637842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.637933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.638130] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.638232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2083.638301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.638458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.638538] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.638772] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.638870] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2083.638933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.639079] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.639158] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.639342] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.639437] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2083.639500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.639644] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.639720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.639807] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 2083.697701] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2083.697902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2083.697902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2083.698065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2083.698222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2083.709628] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 2084.980168] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2084.980589] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2085.722057] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 2085.722332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2089.981354] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2089.981677] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2094.982593] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2094.982974] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2099.984065] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2099.984485] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2104.985911] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2104.986333] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2109.987333] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2109.987713] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2114.988445] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2114.988902] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2119.989773] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2119.989773] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2124.991650] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2124.991650] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2128.171350] env[61817]: INFO networking_nsxv3.common.synchronization [req-f78e0d9f-7c95-445e-a5af-94c1d1276ed1 req-55474b51-609a-40d8-9697-c047841f9180 tempest-ServersNegativeTestJSON-1897410890 tempest-ServersNegativeTestJSON-1897410890-project-member] Enqueued Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGHEST for action security_group_members [ 2128.171900] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGHEST for action security_group_members [ 2128.172339] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2128.172527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2128.172527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2128.173973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2128.173973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2128.173973] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2128.173973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2128.173973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2128.173973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2128.173973] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2128.173973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2128.173973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2128.173973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2128.173973] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2128.173973] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2128.187645] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2128.187785] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2128.187859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2128.188063] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2128.188151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2128.188331] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2128.188423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2128.188487] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2128.188990] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2128.188990] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2128.188990] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 is going to be updated. [ 2128.225472] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2128.225617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2128.225688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2128.225909] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2128.226054] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2128.240608] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 in Status: IN_PROGRESS for 2s [ 2130.258131] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 in Status: SUCCESS [ 2130.258573] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 deletion is rescheduled due to dependency. [ 2130.258573] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2133.173069] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2133.173443] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2138.174578] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2138.174994] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2143.176115] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2143.176434] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2148.177601] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2148.177936] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2153.178674] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2153.178973] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2158.180159] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2158.180541] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2163.181687] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2163.182011] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2168.183018] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2168.183018] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2173.184039] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2173.184386] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2176.552556] env[61817]: INFO networking_nsxv3.common.synchronization [req-eecad92e-0e7a-48ab-9d44-020c1433ced7 req-f12547a3-c195-412b-8af8-7df4ad45469e tempest-ServerDiskConfigTestJSON-1489146392 tempest-ServerDiskConfigTestJSON-1489146392-project-member] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 2176.553068] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 2176.553378] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2176.553490] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2176.553558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2176.553762] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2176.553841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2176.553988] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2176.554078] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2176.554156] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2176.554309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2176.554441] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2176.554527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2176.554582] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2176.554710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2176.554809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2176.554865] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2176.565276] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2176.575378] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2176.585908] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2176.586022] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2176.586119] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2176.586606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2176.586733] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2176.586845] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 2176.621609] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2176.621817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2176.621817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2176.622022] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2176.622174] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2176.638264] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 2178.648292] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 2178.648682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2181.554720] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2181.554720] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2186.556124] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2186.556493] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2191.557450] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2191.557738] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2196.558594] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2196.558877] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2197.004666] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:6 completed [ 2197.004869] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:7 started [ 2201.559995] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2201.560392] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2201.829978] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2201.830226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2201.830226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2201.830364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2201.830451] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2201.830630] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2201.830717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2201.830774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2201.830933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2201.831036] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2201.841102] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2201.856801] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2201.863515] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2201.863653] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2202.474814] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.475044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.475044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.475248] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.486556] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2202.486985] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.487973] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2202.517177] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.517357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.517427] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.517603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.526238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.526765] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 2202.526845] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2202.526932] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2202.549493] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.549673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.549717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.549887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.550340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.550483] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2202.585930] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.586334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.586334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.586334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.586662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.586783] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2202.622320] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.622504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.622542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.622728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.622899] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.623066] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:8. [ 2202.623145] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'75f51202-796b-4ac3-a0b3-2893fc0c366f', '3ffcb57e-8678-415b-bd13-19b60dbd45bd', '809c9d4c-eb3e-493d-bbfc-45d99fd37e44', '5a2644aa-f99a-4b14-9145-702ba5c8452b', '8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0', '434c81a0-40dd-4119-b850-8a8e4707a3f9', '8ccdfdda-5544-48a2-976b-b365f092bbb9', '5233168b-5f93-4bb0-bac2-dd279d965d46'} {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2202.623221] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2202.640770] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.640964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.641002] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.641195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.641291] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.641405] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2202.641477] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2202.641546] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2202.677360] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.677563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.677563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.677769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.678183] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.678352] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2202.678460] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2202.678493] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2202.678556] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 2202.678632] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 8/8 resources of Type:Security Group Rules [ 2202.678701] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGH for action security_group_rules [ 2202.678781] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 2202.678849] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGH for action security_group_rules [ 2202.678909] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 2202.678971] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 2202.679034] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGH for action security_group_rules [ 2202.679089] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGH for action security_group_rules [ 2202.679148] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 2202.679240] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2202.679372] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2202.679502] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.679601] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.679673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.679854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.679934] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.680119] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.680212] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.680265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.680404] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.680477] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.680639] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.680744] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.680801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.680940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.681012] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.681207] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.681286] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.681339] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.681480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.681553] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.681716] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.681805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.681858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.681992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.682064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.682226] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.682317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.682372] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.682502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.682571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.682731] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.682848] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.682909] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.683047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.683120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.683285] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.683377] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.683429] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.683563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.683636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.683802] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.683890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.684055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.684216] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.684293] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.684460] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.684558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.684627] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.684791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.684868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.685033] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.685123] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.685175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.685310] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.685383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.685544] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.685631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.685683] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.685820] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.685922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.686105] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.686196] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.686255] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.686390] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.686462] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.686623] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.686711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.686763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.686897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.686968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.687125] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.687214] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.687265] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.687427] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.687503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.687689] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.687787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.687840] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.687975] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.688066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.688217] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.688307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.688368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.688492] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.688564] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.688736] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.688832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.688890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.689022] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.689094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.689280] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.689376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.689428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.689566] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.689637] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.689826] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.689926] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.689979] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.690119] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.690190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.690355] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.690445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.690498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.690631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.690702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.690861] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.690948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.691001] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.691132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.691232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.691393] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.691483] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.691569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.691669] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.691740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.691899] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.691981] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.692049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.692179] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.692252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.692414] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2202.692500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2202.692553] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2202.692684] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2202.692755] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2202.692852] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:14 [ 2202.692912] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 12 of least updated resources [ 2202.692989] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGH for action security_group_members [ 2202.693066] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGH for action security_group_members [ 2202.693134] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGH for action security_group_members [ 2202.693193] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 160891cf-8fe2-484f-9a30-b133226db788 with Priority: HIGH for action port [ 2202.693257] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6bbbd2da-b17b-4f92-8721-41819ad2061b with Priority: HIGH for action port [ 2202.693313] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGH for action security_group_members [ 2202.693376] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGH for action security_group_members [ 2202.693438] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGH for action security_group_members [ 2202.693499] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f908744f-cc27-4cf9-ae1a-597fb169b177 with Priority: HIGH for action port [ 2202.693552] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGH for action security_group_members [ 2202.693621] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGH for action security_group_members [ 2202.693683] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aaf2b96c-bdf2-45b6-a242-1305fe99123a with Priority: HIGH for action port [ 2202.693772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.561158] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2206.561437] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 2206.561437] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGH for action security_group_rules [ 2206.561567] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 with Priority: HIGH for action security_group_rules [ 2206.561677] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 with Priority: HIGH for action security_group_rules [ 2206.561780] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a with Priority: HIGH for action security_group_members [ 2206.561880] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaf2b96c-bdf2-45b6-a242-1305fe99123a with Priority: HIGH for action port [ 2206.561976] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e583f7e5-364a-4a33-9784-9c313528bb3d with Priority: HIGH for action security_group_members [ 2206.562174] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1620446-f273-4658-baad-13a497dabc74 with Priority: HIGH for action security_group_members [ 2206.562174] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f908744f-cc27-4cf9-ae1a-597fb169b177 with Priority: HIGH for action port [ 2206.562249] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b with Priority: HIGH for action security_group_members [ 2206.562331] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d193cbd-452d-400d-b88e-58fc27978848 with Priority: HIGH for action security_group_members [ 2206.562423] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bbbd2da-b17b-4f92-8721-41819ad2061b with Priority: HIGH for action port [ 2206.562512] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 160891cf-8fe2-484f-9a30-b133226db788 with Priority: HIGH for action port [ 2206.562596] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGH for action security_group_members [ 2206.562684] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f129921-ca53-4911-9bcc-7d661d45384d with Priority: HIGH for action security_group_members [ 2206.562803] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd22888a-f333-48c2-a433-ab2abba8ae54 with Priority: HIGH for action security_group_members [ 2206.562917] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 with Priority: HIGH for action security_group_rules [ 2206.563032] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 2206.563032] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 2206.563106] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 2206.563200] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 2206.563565] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.563694] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.563763] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.563976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.564097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.564267] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.564370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.564431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.564589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.564670] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.565187] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.565295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.565361] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.565512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.565590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.565731] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.565822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.565883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.566024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.566097] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('809c9d4c-eb3e-493d-bbfc-45d99fd37e44',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.566479] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.566583] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.566648] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.566795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.566872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.567010] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ccdfdda-5544-48a2-976b-b365f092bbb9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.567101] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.567163] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.567301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.567373] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ccdfdda-5544-48a2-976b-b365f092bbb9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.567730] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.567833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.567898] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.568055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.568132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.568272] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.568366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.568422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.568803] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.568987] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.569100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.569169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.569319] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.569402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.569488] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3ac00c4-e41d-4288-b6b9-01b5f4714e5a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.569849] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.569955] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.570025] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.570175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.570252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.570398] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaf2b96c-bdf2-45b6-a242-1305fe99123a taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.570493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaf2b96c-bdf2-45b6-a242-1305fe99123a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.570557] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaf2b96c-bdf2-45b6-a242-1305fe99123a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.570699] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaf2b96c-bdf2-45b6-a242-1305fe99123a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.570775] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaf2b96c-bdf2-45b6-a242-1305fe99123a',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.571126] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.571256] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.571323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.571477] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.571555] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.571695] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-e583f7e5-364a-4a33-9784-9c313528bb3d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.571789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.571885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.571986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.572136] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.572252] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.572342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.572497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.572576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.572661] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e583f7e5-364a-4a33-9784-9c313528bb3d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.573050] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.573113] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.573177] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.573366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.573401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.573524] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1620446-f273-4658-baad-13a497dabc74 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.573619] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.573681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.573819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.573952] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.574041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.574101] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.574236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.574313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.574392] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1620446-f273-4658-baad-13a497dabc74',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.574749] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.574852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.574916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.575065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.575141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.575277] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-f908744f-cc27-4cf9-ae1a-597fb169b177 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.575370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f908744f-cc27-4cf9-ae1a-597fb169b177" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.575432] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f908744f-cc27-4cf9-ae1a-597fb169b177" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.575573] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f908744f-cc27-4cf9-ae1a-597fb169b177" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.575644] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f908744f-cc27-4cf9-ae1a-597fb169b177',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.575992] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.576121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.576190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.576340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.576416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.576556] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.576648] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.576709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.576849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.576979] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.577070] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.577131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.577266] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.577343] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.577423] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.577767] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.577869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.577933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.578208] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.578466] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.578466] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d193cbd-452d-400d-b88e-58fc27978848 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.578629] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.578629] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.578720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.578896] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.578992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.579054] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.579199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.579276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.579363] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d193cbd-452d-400d-b88e-58fc27978848',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.579711] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.579813] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.579877] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.580036] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.580113] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.580254] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bbbd2da-b17b-4f92-8721-41819ad2061b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.580347] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bbbd2da-b17b-4f92-8721-41819ad2061b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.580408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bbbd2da-b17b-4f92-8721-41819ad2061b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.580547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bbbd2da-b17b-4f92-8721-41819ad2061b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.580641] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bbbd2da-b17b-4f92-8721-41819ad2061b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.581068] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.581185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.581290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.581470] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.581552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.581695] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-160891cf-8fe2-484f-9a30-b133226db788 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.581789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-160891cf-8fe2-484f-9a30-b133226db788" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.581851] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-160891cf-8fe2-484f-9a30-b133226db788" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.581993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-160891cf-8fe2-484f-9a30-b133226db788" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.582066] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('160891cf-8fe2-484f-9a30-b133226db788',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.582415] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.582522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.582589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.582737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.582814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.582953] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.583045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.583186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.583250] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.583369] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.583461] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.583522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.583657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.583732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.583813] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.585799] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.585923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.585996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.586155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.586237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.586383] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f129921-ca53-4911-9bcc-7d661d45384d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.586478] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.586542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.586686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.586819] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.586913] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.586976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.587122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.587287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.587287] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f129921-ca53-4911-9bcc-7d661d45384d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.587638] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.587743] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.587811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.587959] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.588049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.588193] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd22888a-f333-48c2-a433-ab2abba8ae54 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.588289] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.588353] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.588497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.588628] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.588722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.588784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.588921] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.588998] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.589083] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd22888a-f333-48c2-a433-ab2abba8ae54',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.589436] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.589544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.589610] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.589756] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.589833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.589973] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-434c81a0-40dd-4119-b850-8a8e4707a3f9 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.590065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.590128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.590268] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.590342] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('434c81a0-40dd-4119-b850-8a8e4707a3f9',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.590691] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.590793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.590861] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.591026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.591165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.591346] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.591446] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.591510] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.591661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.591728] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.592084] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.592213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.592294] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.592448] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.592526] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.592668] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.592762] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.592826] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.592970] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.593042] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.593395] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.593505] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.593596] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.593799] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.593882] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.594026] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.594122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.594185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.594330] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.594403] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.594752] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.594855] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.594966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.595128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.595205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.595348] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.595441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.595504] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.595661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.595736] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.659991] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.660186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.660262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.660474] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.660564] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.660753] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.660849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.660912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.661057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.661136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.661275] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3ac00c4-e41d-4288-b6b9-01b5f4714e5a is going to be deleted. [ 2206.677883] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.678959] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.679099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.679188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.679394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.679484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.679659] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.679760] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.679809] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.679951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.680037] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.680116] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d193cbd-452d-400d-b88e-58fc27978848 is going to be deleted. [ 2206.681161] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.681324] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.681381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.681498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.681573] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.681932] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.682056] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.682122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.682413] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.682513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.682584] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b is going to be deleted. [ 2206.685864] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.685984] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.686036] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.686191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.686268] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.686432] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.686523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.686583] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.686720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.686793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.686874] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f129921-ca53-4911-9bcc-7d661d45384d is going to be deleted. [ 2206.698976] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.699165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.699165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.699332] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.699425] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.699520] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3ac00c4-e41d-4288-b6b9-01b5f4714e5a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.702183] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.702379] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.702434] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.702591] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.702669] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.702828] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.702906] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.721031] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f908744f-cc27-4cf9-ae1a-597fb169b177 with status ACTIVE [ 2206.721268] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.721404] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.721473] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.721672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.721752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.721918] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.722010] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.722069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.722227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.722328] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.725147] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.725266] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.725325] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.725486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.728801] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aaf2b96c-bdf2-45b6-a242-1305fe99123a with status ACTIVE [ 2206.728964] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.729068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.729131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.729286] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.729365] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.729525] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.729614] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.729672] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.730026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.730147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.731419] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.731514] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.731718] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.731841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.733423] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.733524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.733588] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.733743] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.733869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.733923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d193cbd-452d-400d-b88e-58fc27978848" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.735729] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.735830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.735902] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.736065] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.736146] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.736234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f129921-ca53-4911-9bcc-7d661d45384d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.736881] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.736983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.737045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.737198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.737290] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.737385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3168d7e7-5934-4bf3-b3a7-bed68a6f3f7b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.738615] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.739665] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.739753] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.743073] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bbbd2da-b17b-4f92-8721-41819ad2061b with status ACTIVE [ 2206.743291] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.743435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.743503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.743676] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.743757] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.743917] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.744020] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.744081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.744231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.744305] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.749997] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.750136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.750187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.750344] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.750423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.750511] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f is going to be updated. [ 2206.751844] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.752192] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.752296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.752479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.752565] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.752719] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.752817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.752882] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.753028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.753167] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.753259] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.753531] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.753686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.753767] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.753851] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.753938] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.765420] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.765420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.765420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.765420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.765420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.765420] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.765420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.765420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.765420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.765420] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.765420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.765420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.765420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.765420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.765420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.765420] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.766184] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.766184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.766184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.766184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.766184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.766184] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.766184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.766184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.766184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.766184] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.766184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.766184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.766184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.766184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.766184] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.766184] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.766735] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.766735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.766735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.766735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.766735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.766735] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.766735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.766735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.766735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.766735] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.766735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.766735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.767161] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.767161] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.767161] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.767161] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.770766] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.770928] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.771004] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.771235] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.771302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.771454] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.771552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.771617] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.771762] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.771900] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.771994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.772099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.772260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.772337] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.772420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.772567] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.772658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.772720] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.772961] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.773048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.773191] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.773285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.773347] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.773488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.773622] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.773711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.773772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.773921] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.774034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.774129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.774308] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.775801] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 160891cf-8fe2-484f-9a30-b133226db788 with status ACTIVE [ 2206.775995] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.776153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.776225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.776620] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.776620] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.776771] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.776872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.776937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.777087] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.777168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.778347] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.778459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.778563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.778705] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.778804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.778980] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.779084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.779146] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.779295] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.779439] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.779532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.779594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.779733] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.779811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.779890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.780055] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.780149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.780210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.780349] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.780423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.780561] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.780652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.780712] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.780849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.780979] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.781069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.781129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.781292] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.781370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.781451] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.781535] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.785112] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.785212] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.786000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.786109] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ccdfdda-5544-48a2-976b-b365f092bbb9 is going to be deleted. [ 2206.787146] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5233168b-5f93-4bb0-bac2-dd279d965d46: rpc.has_security_group_logging(os_id): False [ 2206.789619] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.789761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.789869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.790085] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.790183] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.790339] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.790438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.790503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.790658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.790798] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.790891] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.790953] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.791094] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.791182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.791271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.791424] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.791517] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.791579] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.791721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.791794] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.791933] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.792034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.792096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.792262] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.792406] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.792501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.792560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.792698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.792775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.792853] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.792938] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.794890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.795052] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.795198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.795314] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.795412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.795476] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.795616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.795691] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.795776] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1620446-f273-4658-baad-13a497dabc74 is going to be deleted. [ 2206.798374] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.798738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.798830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.798967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.799048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.799197] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.799345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.799416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.799586] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.799729] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.799825] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.799888] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.800038] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.800116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.800198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.800349] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.800442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.800503] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.800642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.800716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.800853] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.800944] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.801005] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.801140] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.801299] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.801394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.801455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.801592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.801667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.801747] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.801834] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2206.802710] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0: rpc.has_security_group_logging(os_id): False [ 2206.803740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.803904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.804048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.804186] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.804714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.804788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.804937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.805018] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.805107] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e583f7e5-364a-4a33-9784-9c313528bb3d is going to be deleted. [ 2206.812631] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ffcb57e-8678-415b-bd13-19b60dbd45bd: rpc.has_security_group_logging(os_id): False [ 2206.813988] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.814190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.814287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.814505] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.814613] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.814676] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.814827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.814905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.814992] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd22888a-f333-48c2-a433-ab2abba8ae54 is going to be deleted. [ 2206.816188] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a2644aa-f99a-4b14-9145-702ba5c8452b: rpc.has_security_group_logging(os_id): False [ 2206.818517] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.818651] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.818722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.818906] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.819052] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.824466] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.824697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.834588] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.834792] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.838133] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.838236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.885894] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.886119] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.886785] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f in Status: IN_PROGRESS for 2s [ 2206.891768] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.891964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.899649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.899835] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 809c9d4c-eb3e-493d-bbfc-45d99fd37e44 is going to be deleted. [ 2206.900857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.901120] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.907662] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.907848] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.951777] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.952028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.952028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.952216] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.952351] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.952460] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e583f7e5-364a-4a33-9784-9c313528bb3d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.953289] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.953402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.953473] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.953643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.953726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.953819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd22888a-f333-48c2-a433-ab2abba8ae54" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.954499] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.954608] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.954676] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.954830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.954909] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.954999] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1620446-f273-4658-baad-13a497dabc74" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.955748] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.955944] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.956061] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.956128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.956282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.956365] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.956558] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.956654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.956717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.956859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.956934] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.957130] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2206.957213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2206.957276] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.957440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2206.957520] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2206.957618] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 2206.958985] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2206.959146] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.036482] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.036728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.058734] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.058969] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.060142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.060273] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 434c81a0-40dd-4119-b850-8a8e4707a3f9 is going to be deleted. [ 2207.061227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.061456] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.106536] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.106824] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.106948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.107017] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.107226] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.107312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.107520] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.107625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.107686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.107834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.107908] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.108110] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.108185] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.108242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.108383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.108519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.108620] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 2207.109892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.110047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.173843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.174289] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.174416] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.174486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.174698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.174784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.175202] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.175202] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.175202] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.175323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.175459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.175600] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.175687] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.175751] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.175898] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.175974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.176096] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 2207.177241] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.177414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.177522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.177639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ccdfdda-5544-48a2-976b-b365f092bbb9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.177775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.177925] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.178006] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.178111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-809c9d4c-eb3e-493d-bbfc-45d99fd37e44" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.178264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.178413] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.235840] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.236050] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.242633] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.242815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.253320] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.253624] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.253802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.253802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.254019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.254105] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.254314] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.254417] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.254483] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.254635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.254711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.254898] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.254979] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.255042] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.255186] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.255264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.255358] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be updated. [ 2207.256532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.256722] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.256818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.256924] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-434c81a0-40dd-4119-b850-8a8e4707a3f9" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.257061] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.257217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.257353] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.306231] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.306436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.306483] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.306682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.306843] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.313408] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 2207.330405] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 2207.443285] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.443498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.443498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.443714] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.443888] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.479243] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2207.479511] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2207.479599] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2207.479921] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2207.480195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2207.482615] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 2207.514165] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2207.514713] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 2208.567494] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2208.568280] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.568561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.568671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.568989] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.569153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.569323] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aaf2b96c-bdf2-45b6-a242-1305fe99123a is going to be updated. [ 2208.591775] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.592042] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.592174] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.592514] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.592742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.592995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaf2b96c-bdf2-45b6-a242-1305fe99123a" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.618996] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2208.619794] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.619974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.620119] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.620436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.620556] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.620673] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f908744f-cc27-4cf9-ae1a-597fb169b177 is going to be updated. [ 2208.622797] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.622922] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.622995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.623158] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.623244] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.623339] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bbbd2da-b17b-4f92-8721-41819ad2061b is going to be updated. [ 2208.624895] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.625028] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.625113] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.625220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.625294] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.625377] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 160891cf-8fe2-484f-9a30-b133226db788 is going to be updated. [ 2208.663008] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.663217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.663217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.663422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.663559] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.663715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-160891cf-8fe2-484f-9a30-b133226db788" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.665067] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2208.665589] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.665727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.665774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.665966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.666093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.666244] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bbbd2da-b17b-4f92-8721-41819ad2061b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.667125] env[61817]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 2208.667562] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.667795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.667795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.667937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.668072] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.668216] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f908744f-cc27-4cf9-ae1a-597fb169b177" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.896656] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f in Status: SUCCESS [ 2208.896886] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.897057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.897272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.897467] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.897586] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.897654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.897800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.897880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.897963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.898053] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2208.910128] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.910382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.910382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.910543] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.910628] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.910789] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.910880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.910940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.911512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.911512] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.911512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.911512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.911512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.911791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.911791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.911791] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.911896] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.911929] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.912076] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.912144] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.912337] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.912406] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.912452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.912651] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.912715] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.912847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.912847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.912968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.913041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.913118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.913205] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2208.921121] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75f51202-796b-4ac3-a0b3-2893fc0c366f: rpc.has_security_group_logging(os_id): False [ 2208.938844] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.939060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.939060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.939287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.959668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.960062] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.960201] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.960270] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.960478] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.960574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.960801] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.960905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.960972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.961136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.961232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.961428] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2208.961535] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2208.961607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2208.961743] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2208.961824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2208.961915] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f is going to be updated. [ 2209.036714] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2209.036893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2209.036934] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2209.037138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2209.037288] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2209.050267] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f in Status: IN_PROGRESS for 2s [ 2209.327230] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 2209.327512] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2209.339804] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 2209.340062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2209.495744] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 2209.495933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2209.526930] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 2209.527175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2211.069349] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f in Status: SUCCESS [ 2211.069719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2211.564888] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2211.565068] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2216.566039] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2216.566368] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2221.567703] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2221.567703] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2222.857859] env[61817]: INFO networking_nsxv3.common.synchronization [req-11126721-00e1-467d-8944-084a1fed6530 req-66586ba7-bf2e-4c1c-9401-29dfeeffc92a tempest-ImagesTestJSON-1042540315 tempest-ImagesTestJSON-1042540315-project-member] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2222.858363] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2222.858668] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.858817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.858858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.859033] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.859115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.859270] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.859364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.859420] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.859567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.859698] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.859779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.859832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.859963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.860051] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.860136] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2222.868564] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2222.881387] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2222.888863] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.888998] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.889070] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.889285] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.889378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.889476] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 2222.921352] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2222.921520] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2222.921564] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2222.921757] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2222.921909] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2222.930555] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 2224.941228] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 2224.941611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2227.859835] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2227.860283] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2232.861478] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2232.861784] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2237.862490] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2237.862796] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2242.864449] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2242.864832] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2247.866402] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2247.866729] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2252.868034] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2252.868448] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2257.869417] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2257.869748] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2262.870507] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2262.870868] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2267.871727] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2267.872128] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2271.810092] env[61817]: INFO networking_nsxv3.common.synchronization [req-f2f5ea90-8b0b-41d5-ba66-58f170f98acf req-dc2643b0-290c-4b67-9e55-a0dfaae4d75d tempest-ServersTestJSON-1722207346 tempest-ServersTestJSON-1722207346-project-member] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 2271.810653] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 2271.811003] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2271.811131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2271.811233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2271.811465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2271.811562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2271.811726] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2271.811827] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2271.811886] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2271.812060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2271.812212] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2271.812310] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2271.812370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2271.812523] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2271.812623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2271.812714] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2271.824600] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2271.836250] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2271.848665] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2271.848811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2271.848875] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2271.849068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2271.849160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2271.849517] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be updated. [ 2271.883235] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2271.883654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2271.883845] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2271.884182] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2271.884432] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2271.900598] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 2273.911190] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 2273.911590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2276.812083] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2276.812469] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2281.813280] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2281.813673] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2286.814590] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2286.814934] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2291.816499] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2291.816499] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2296.818002] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2296.818428] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2301.819499] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2301.819499] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2306.820992] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2306.821436] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2311.822331] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2311.822700] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2316.823716] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2316.824225] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2321.825349] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2321.825692] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2322.888142] env[61817]: INFO networking_nsxv3.common.synchronization [req-e3edebb4-312c-4d5a-9099-8eaa39a25a55 req-cd402ced-2584-4032-a13f-a92536f878a5 tempest-DeleteServersTestJSON-1745478556 tempest-DeleteServersTestJSON-1745478556-project-member] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2322.888606] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2322.888926] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2322.889049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2322.889128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2322.889316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2322.889421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2322.889579] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2322.889675] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2322.889730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2322.889887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2322.890022] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2322.890110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2322.890165] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2322.890299] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2322.890373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2322.890468] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2322.899223] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2322.908057] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2322.918422] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2322.918583] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2322.918654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2322.918855] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2322.918943] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2322.919039] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 2322.958036] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2322.958701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2322.958701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2322.958701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2322.958701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2322.988027] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 2325.001031] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 2325.001031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2327.890317] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2327.890679] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2332.891606] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2332.892055] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2337.893394] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2337.893826] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2342.894488] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2342.894488] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2347.895876] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2347.896284] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2352.896914] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2352.897247] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2357.898232] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2357.898650] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2362.899379] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2362.899736] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2367.900370] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2367.900673] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2372.901676] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2372.901973] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2373.192426] env[61817]: INFO networking_nsxv3.common.synchronization [req-c11b35ca-5602-4786-a171-b11a20b401ee req-e9e44a39-513e-4fc3-ae51-8bf51b6e3dca tempest-ServerAddressesTestJSON-825595071 tempest-ServerAddressesTestJSON-825595071-project-member] Enqueued Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGHEST for action security_group_members [ 2373.192943] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGHEST for action security_group_members [ 2373.193546] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2373.193688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2373.193758] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2373.193965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2373.194055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2373.194220] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2373.194318] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2373.194383] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2373.194535] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2373.194673] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2373.194764] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2373.194825] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2373.194967] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2373.195047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2373.195145] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2373.204217] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2373.204379] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2373.204439] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2373.204574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2373.204660] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2373.204842] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2373.204930] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2373.204988] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2373.205129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2373.205200] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2373.205282] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f is going to be updated. [ 2373.243050] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2373.243270] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2373.243370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2373.243627] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2373.243801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2373.259019] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f in Status: IN_PROGRESS for 2s [ 2375.269171] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f in Status: SUCCESS [ 2375.269506] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f deletion is rescheduled due to dependency. [ 2375.269506] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2378.194516] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2378.194973] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2383.195554] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2383.195944] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2388.196302] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2388.196631] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2393.197499] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2393.197781] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2398.198659] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2398.199010] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2403.187926] env[61817]: INFO networking_nsxv3.common.synchronization [req-70e06b92-7067-4c1c-af88-9dde4c61474a req-b6b0d075-d528-4d3d-b7ff-cfee75307bd8 tempest-ImagesTestJSON-1042540315 tempest-ImagesTestJSON-1042540315-project-member] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2403.191356] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2403.191356] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.191356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.191356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.191356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.191356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.191356] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.191356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.191356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.191356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.191356] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.191356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.191356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.191356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.191356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.191356] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2403.199621] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2403.209869] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2403.217331] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.217666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.217835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.218112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.218391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.218851] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 2403.249726] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.250069] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.250229] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.250513] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.250761] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.260773] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 2403.496472] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.496629] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.496759] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.497022] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.497168] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.497413] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-16 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.497566] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.497681] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.497897] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.498135] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.498283] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.498397] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.498596] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.498732] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.498871] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-16" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.499108] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.499256] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.499398] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.499607] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.499739] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.499965] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-79737faa-7eb8-4fc8-8d20-1904df20bf1d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.500128] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-79737faa-7eb8-4fc8-8d20-1904df20bf1d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.500242] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-79737faa-7eb8-4fc8-8d20-1904df20bf1d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.500526] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-79737faa-7eb8-4fc8-8d20-1904df20bf1d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.500670] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79737faa-7eb8-4fc8-8d20-1904df20bf1d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2403.516169] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.516355] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.516481] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.516720] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.516925] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.517002] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 79737faa-7eb8-4fc8-8d20-1904df20bf1d not found, creating... [ 2403.517252] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.517394] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.517516] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.517726] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.517864] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.518191] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.518347] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.518467] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.518674] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.518807] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.518945] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 79737faa-7eb8-4fc8-8d20-1904df20bf1d is going to be created. [ 2403.542506] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.542742] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.542847] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.543124] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.543472] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.543754] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-79737faa-7eb8-4fc8-8d20-1904df20bf1d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.757746] env[61817]: INFO networking_nsxv3.common.synchronization [req-70e06b92-7067-4c1c-af88-9dde4c61474a req-ec78cb31-3480-4873-b680-d08dc94cdc98 service neutron] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_rules [ 2403.757940] env[61817]: INFO networking_nsxv3.common.synchronization [req-70e06b92-7067-4c1c-af88-9dde4c61474a req-ec78cb31-3480-4873-b680-d08dc94cdc98 service neutron] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2403.758089] env[61817]: INFO networking_nsxv3.common.synchronization [req-70e06b92-7067-4c1c-af88-9dde4c61474a req-ec78cb31-3480-4873-b680-d08dc94cdc98 service neutron] Enqueued Resource ID: 79737faa-7eb8-4fc8-8d20-1904df20bf1d with Priority: HIGHEST for action port [ 2403.758322] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_rules [ 2403.758455] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2403.758559] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79737faa-7eb8-4fc8-8d20-1904df20bf1d with Priority: HIGHEST for action port [ 2403.759167] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.759251] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.759299] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.759507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.759600] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.759768] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.760346] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.760430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.760598] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.760685] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2403.761836] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.761948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.762017] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.762170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.762247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.762432] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.762525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.762923] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.763034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.763099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.763250] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.763334] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.763476] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-79737faa-7eb8-4fc8-8d20-1904df20bf1d taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.763560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79737faa-7eb8-4fc8-8d20-1904df20bf1d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.763641] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79737faa-7eb8-4fc8-8d20-1904df20bf1d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.763795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79737faa-7eb8-4fc8-8d20-1904df20bf1d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.763868] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79737faa-7eb8-4fc8-8d20-1904df20bf1d',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2403.782623] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79737faa-7eb8-4fc8-8d20-1904df20bf1d with status ACTIVE [ 2403.782754] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.782878] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.782948] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.783151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.783239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.783410] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.783501] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.783563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.783709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.783783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.786128] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.786242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2403.786309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2403.786491] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2403.786620] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2403.786778] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2403.786865] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2404.118927] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2404.119194] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2404.119308] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2404.119566] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2404.119667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2404.119781] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79737faa-7eb8-4fc8-8d20-1904df20bf1d is going to be updated. [ 2404.141183] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2404.141486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2404.141486] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2404.141664] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2404.141804] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2404.141966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79737faa-7eb8-4fc8-8d20-1904df20bf1d" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2405.270730] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 2405.271055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2405.271180] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2405.271563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2405.271814] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2405.272110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2405.272110] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2405.272317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2405.272415] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2405.272516] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2405.282540] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2405.291542] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2405.299115] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2405.299351] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2405.299410] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2405.299607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2405.299698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2405.299795] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 2405.331589] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2405.331811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2405.331811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2405.332183] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2405.332440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2405.342800] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 2407.353981] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 2407.354298] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.354342] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.354612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.354744] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2407.354867] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2407.354935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.355131] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.355223] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.355312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.355403] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2407.365650] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2407.365788] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2407.365828] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.366003] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.366086] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.366241] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2407.366338] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2407.366401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.366541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.366682] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2407.366772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2407.366832] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.366972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.367050] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.367142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.367305] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2407.367401] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2407.367469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.367600] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.367671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.367814] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2407.367905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2407.367966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.368122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.368254] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2407.368370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2407.368424] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.368542] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.368612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.368691] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.368779] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2407.375635] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a2644aa-f99a-4b14-9145-702ba5c8452b: rpc.has_security_group_logging(os_id): False [ 2407.392708] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2407.392864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2407.392917] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.393124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.393215] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.393468] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2407.393554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2407.393594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.393741] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.393818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.394006] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2407.394100] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2407.394169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.394301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.394402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.394586] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2407.394680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2407.394741] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.394946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.394946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.395051] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 2407.460043] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2407.460234] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2407.460282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2407.460467] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2407.460639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2407.472829] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 2408.759318] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2408.759758] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2409.486737] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 2409.487001] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2413.760679] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2413.761055] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2418.761436] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2418.761863] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2421.596180] env[61817]: INFO networking_nsxv3.common.synchronization [req-7d875463-400a-4752-8f42-613d12e23133 req-97734ef4-f41f-4cda-9ff1-963258cb0cfc tempest-ServerDiskConfigTestJSON-1489146392 tempest-ServerDiskConfigTestJSON-1489146392-project-member] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 2421.596701] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGHEST for action security_group_members [ 2421.597024] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2421.597139] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2421.597220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2421.597594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2421.597594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2421.597750] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2421.597750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2421.597848] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2421.602527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2421.602527] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2421.602527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2421.602527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2421.602527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2421.602527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2421.602527] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2421.611348] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2421.611514] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2421.611567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2421.611735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2421.611822] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2421.612016] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2421.612111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2421.612180] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2421.612336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2421.612438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2421.612521] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be updated. [ 2421.643785] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2421.643942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2421.643984] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2421.644205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2421.644354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2421.652435] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: IN_PROGRESS for 2s [ 2423.663562] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 in Status: SUCCESS [ 2423.663562] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 deletion is rescheduled due to dependency. [ 2423.663984] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2426.597757] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2426.598118] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2431.599788] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2431.599788] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2436.600963] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2436.601501] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2437.005935] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:7 completed [ 2437.006066] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:8 started [ 2441.602321] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2441.602321] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2441.836134] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2441.836134] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2441.836134] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2441.836134] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2441.836134] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2441.836134] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2441.836528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2441.836528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2441.836528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2441.836621] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2441.845430] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2441.851770] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2441.857511] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2441.857610] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2442.538625] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.538868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.538868] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.539041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.550606] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2442.551046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.552079] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2442.582323] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.582488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.582558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.582757] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.590327] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.590818] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:3. [ 2442.590901] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'960585e7-0fdc-4b15-aedc-534a4526aa4e', '1a59cd4a-9a1d-49c2-9974-dd518b422d9e', '434d0eb5-2f24-4806-8f4e-9dfd5e5e9023'} {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2442.590991] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2442.612568] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.612903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.612903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.613002] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.613286] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.613407] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2442.642447] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.642636] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.642680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.642859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.643057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.643209] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2442.671193] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.671396] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.671445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.671625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.671781] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.671937] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:5. [ 2442.672030] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'75f51202-796b-4ac3-a0b3-2893fc0c366f', '3ffcb57e-8678-415b-bd13-19b60dbd45bd', '5a2644aa-f99a-4b14-9145-702ba5c8452b', '8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0', '5233168b-5f93-4bb0-bac2-dd279d965d46'} {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2442.672111] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2442.690389] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.690569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.690612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.690789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.690876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.690984] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2442.691054] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2442.691123] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2442.722467] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.722631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.722631] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.722814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.723115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.723262] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2442.723338] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2442.723410] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2442.723478] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 3/3 resources of Type:Ports [ 2442.723561] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 960585e7-0fdc-4b15-aedc-534a4526aa4e with Priority: HIGH for action port [ 2442.723659] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a59cd4a-9a1d-49c2-9974-dd518b422d9e with Priority: HIGH for action port [ 2442.723734] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 434d0eb5-2f24-4806-8f4e-9dfd5e5e9023 with Priority: HIGH for action port [ 2442.723806] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 5/5 resources of Type:Security Group Rules [ 2442.723871] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGH for action security_group_rules [ 2442.723936] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 2442.723999] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 2442.724076] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 2442.724138] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 2442.724206] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2442.724269] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2442.724444] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.724544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.724605] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.724759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.724835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.725000] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.725091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.725151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.725288] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.725362] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.725523] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.725612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.725671] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.725806] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.725878] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.726038] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.726128] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.726187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.726323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.726397] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.726562] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.726652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.726710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.726846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.726918] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.727077] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.727166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.727223] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.727356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.727430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.727587] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.727692] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.727732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.727852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.727923] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.728099] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.728188] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.728245] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.728380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.728452] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.728616] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.728710] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.728749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.728875] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.728946] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.729104] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.729191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.729248] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.729381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.729453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.729609] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.729695] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.729752] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.729884] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.729954] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.730110] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.730196] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.730253] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.730385] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.730458] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.730614] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.730701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.730758] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.730890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.730961] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.731119] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2442.731205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2442.731261] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2442.731419] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2442.731494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2442.731587] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:2 [ 2442.731651] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 2 of least updated resources [ 2442.731723] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGH for action security_group_members [ 2442.731799] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGH for action security_group_members [ 2442.731883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.604053] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2446.604053] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=10], Jobs=0 [ 2446.604407] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 960585e7-0fdc-4b15-aedc-534a4526aa4e with Priority: HIGH for action port [ 2446.604407] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 434d0eb5-2f24-4806-8f4e-9dfd5e5e9023 with Priority: HIGH for action port [ 2446.604407] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 2446.604527] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 with Priority: HIGH for action security_group_members [ 2446.604559] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 with Priority: HIGH for action security_group_members [ 2446.604658] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 2446.604737] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 with Priority: HIGH for action security_group_rules [ 2446.604831] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 2446.604925] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a59cd4a-9a1d-49c2-9974-dd518b422d9e with Priority: HIGH for action port [ 2446.605016] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f with Priority: HIGH for action security_group_rules [ 2446.605370] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.605507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.605576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.605782] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.605882] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.606045] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-960585e7-0fdc-4b15-aedc-534a4526aa4e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.606136] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-960585e7-0fdc-4b15-aedc-534a4526aa4e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.606194] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-960585e7-0fdc-4b15-aedc-534a4526aa4e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.606414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-960585e7-0fdc-4b15-aedc-534a4526aa4e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.606500] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('960585e7-0fdc-4b15-aedc-534a4526aa4e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.607468] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.607585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.607655] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.607811] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.607884] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.608039] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-434d0eb5-2f24-4806-8f4e-9dfd5e5e9023 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.608129] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-434d0eb5-2f24-4806-8f4e-9dfd5e5e9023" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.608191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-434d0eb5-2f24-4806-8f4e-9dfd5e5e9023" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.608356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-434d0eb5-2f24-4806-8f4e-9dfd5e5e9023" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.608429] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('434d0eb5-2f24-4806-8f4e-9dfd5e5e9023',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.609749] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.609856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.609931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.610087] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.610135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.610289] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.610360] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.610425] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.610541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.610607] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.611627] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.611723] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.611795] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.611938] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.612036] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.612183] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbf8f627-b3e9-41d3-bf72-822741bb5374 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.612281] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.612356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.612519] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.612653] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.612743] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.612802] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.612933] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.613004] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.613080] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbf8f627-b3e9-41d3-bf72-822741bb5374',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.614290] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.614409] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.614463] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.614604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.614756] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.614901] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-62ddbcee-1db4-4515-8d5b-c25d44008cc0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.614997] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.615064] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.615187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.615316] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.615403] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.615462] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.615594] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.615665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.615742] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62ddbcee-1db4-4515-8d5b-c25d44008cc0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.616793] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.616912] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.616957] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.617104] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.617175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.617331] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.617408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.617465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.617589] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.617656] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.618539] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.618654] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.618700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.618847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.618917] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.619051] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5233168b-5f93-4bb0-bac2-dd279d965d46 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.619137] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.619208] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.619327] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.619401] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5233168b-5f93-4bb0-bac2-dd279d965d46',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.620187] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.620273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.620392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.620475] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.620550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.620687] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.620774] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.620838] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.620964] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.621029] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.621875] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.621875] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.621991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.622076] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.622153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.622293] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a59cd4a-9a1d-49c2-9974-dd518b422d9e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.622381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a59cd4a-9a1d-49c2-9974-dd518b422d9e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.622445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a59cd4a-9a1d-49c2-9974-dd518b422d9e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.622666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a59cd4a-9a1d-49c2-9974-dd518b422d9e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.622748] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a59cd4a-9a1d-49c2-9974-dd518b422d9e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.625101] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.625216] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.625268] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.625411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.625485] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.625620] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75f51202-796b-4ac3-a0b3-2893fc0c366f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.625726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.625794] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.625937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.626016] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75f51202-796b-4ac3-a0b3-2893fc0c366f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.636494] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 434d0eb5-2f24-4806-8f4e-9dfd5e5e9023 [ 2446.636610] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.636715] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.636779] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.636942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.637019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.638237] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.638378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.638426] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.638605] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.638639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.638796] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.639003] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.639003] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.639081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.639148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.639229] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbf8f627-b3e9-41d3-bf72-822741bb5374 is going to be deleted. [ 2446.673532] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.673765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.673765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.674004] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.674121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.674358] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.674479] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.674595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.674749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.674915] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.675027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.675103] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.675267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.675370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.675480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.675588] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.682567] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.682567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.682745] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.682841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.682951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.683125] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.683247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.683333] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.683509] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.683675] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.683790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.683869] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.684053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.684160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.684272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.684408] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.685324] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.685472] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.685561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.685740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.685836] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.686007] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.686124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.686206] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.686374] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.686547] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.686662] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.686741] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.686927] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.687045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.687154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.687259] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.689490] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.689584] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.689635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.689830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.689917] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.690007] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbf8f627-b3e9-41d3-bf72-822741bb5374" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.692538] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.692655] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.692697] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.692854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.692934] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.693102] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.693195] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.693258] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.693428] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.693468] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.693544] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62ddbcee-1db4-4515-8d5b-c25d44008cc0 is going to be deleted. [ 2446.694491] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 960585e7-0fdc-4b15-aedc-534a4526aa4e [ 2446.694648] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.694737] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.694803] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.694951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.695034] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.699511] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.699621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.699693] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.699860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.699944] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.700122] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.700217] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.700282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.700427] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.700567] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.700658] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.700719] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.700855] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.700930] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.701011] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.701153] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.701242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.701301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.701467] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.702225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.702225] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.702225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.702225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.702225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.702225] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.702225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.702225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.702561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.702561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.702561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.702561] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.708080] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.708189] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.708247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.708414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.708498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.708651] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.708747] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.708812] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.708956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.709096] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.709197] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.709298] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.709438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.709518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.709602] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.709752] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.709844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.709905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.710041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.710112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.710266] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.710337] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.710393] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.710529] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.710662] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.710750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.710810] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.710942] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.711013] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.711093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.711179] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.714160] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.714277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.714329] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.714497] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.714613] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.714775] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.714871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.714936] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.715082] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.715219] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.715312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.715377] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.715515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.715592] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.715674] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.715819] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.715908] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.715968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.716138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.716212] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.716351] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.716445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.716502] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.716685] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.716763] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.716853] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.716914] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.717046] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.717121] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.717198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.717284] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2446.719183] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.719373] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.719443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.719552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.728811] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a2644aa-f99a-4b14-9145-702ba5c8452b: rpc.has_security_group_logging(os_id): False [ 2446.729678] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0: rpc.has_security_group_logging(os_id): False [ 2446.730540] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a59cd4a-9a1d-49c2-9974-dd518b422d9e [ 2446.730774] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.730956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.731029] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.731216] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.731336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.734617] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ffcb57e-8678-415b-bd13-19b60dbd45bd: rpc.has_security_group_logging(os_id): False [ 2446.736314] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.736441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.736511] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.736698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.736790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.736886] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62ddbcee-1db4-4515-8d5b-c25d44008cc0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.750508] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.750680] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.755027] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.755162] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5233168b-5f93-4bb0-bac2-dd279d965d46 is going to be deleted. [ 2446.756122] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.756345] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.767742] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.767959] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.768880] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.768982] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.776867] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.777062] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.784495] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.784646] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75f51202-796b-4ac3-a0b3-2893fc0c366f is going to be deleted. [ 2446.785518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.785730] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.817045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.817346] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.817475] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.817544] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.817745] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.817828] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.818034] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.818135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.818198] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.818354] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.818430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.818604] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.818684] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.818745] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.818884] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.818958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.819049] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 2446.820730] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.820833] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.820887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.821041] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.821127] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.821236] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5233168b-5f93-4bb0-bac2-dd279d965d46" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.821423] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.821561] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.828683] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.828851] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.828894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.829036] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.829124] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.829304] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-960585e7-0fdc-4b15-aedc-534a4526aa4e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.830035] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.830148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.830249] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.830410] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.830494] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.830616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-434d0eb5-2f24-4806-8f4e-9dfd5e5e9023" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.831362] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.831484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.831554] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.831707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.831786] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.831935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a59cd4a-9a1d-49c2-9974-dd518b422d9e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.843580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.843831] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.843947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.844047] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.844224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.844307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.844559] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.844663] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.844726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.844872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.844947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.845124] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.845204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.845267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.845405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.845481] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.845565] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 2446.846643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.846807] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.849900] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.849990] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.878669] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.878945] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.879071] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.879141] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.879370] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.879460] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.879680] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.879784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.879849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.880014] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.880099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.880285] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.880369] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.880431] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.880572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.880649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.880777] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be updated. [ 2446.881887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.882081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.882189] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.882326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75f51202-796b-4ac3-a0b3-2893fc0c366f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.956146] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2446.956378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2446.956378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2446.956530] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2446.956700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2446.994259] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 2447.012660] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2447.012817] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2447.012877] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2447.013088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2447.013247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2447.015334] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2447.015464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2447.015534] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2447.015724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2447.015867] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2447.041504] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 2447.042347] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 2449.009036] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 2449.009411] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2449.060186] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 2449.060391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2449.060954] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 2449.061132] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2451.606301] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2451.606744] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2456.607379] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2456.607759] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2461.608494] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2461.608494] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2466.610040] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2466.610481] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2471.611598] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2471.611968] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2472.013877] env[61817]: INFO networking_nsxv3.common.synchronization [req-d09e6d4f-cbd3-4252-902d-e7d55d94847f req-d476dde1-8b96-4bb2-b9c2-5773a762342d tempest-ImagesTestJSON-1042540315 tempest-ImagesTestJSON-1042540315-project-member] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2472.014410] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2472.014803] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.014885] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.014996] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.015097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.015199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.015336] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.015441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.015787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.015787] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.015787] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.015968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.015968] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.016053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.016119] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.016207] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2472.024106] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2472.034325] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2472.046557] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.046824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.046824] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.047073] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.047187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.047324] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 2472.087338] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.087484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.087547] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.087746] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.087906] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.104890] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 2472.643609] env[61817]: INFO networking_nsxv3.common.synchronization [req-910d9db5-5da8-411b-a2a4-3a11e3bbc51f req-0441e382-efda-4728-91c4-7b256c407cc1 tempest-DeleteServersTestJSON-1745478556 tempest-DeleteServersTestJSON-1745478556-project-member] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2472.644203] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2472.644526] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.644646] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.644711] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.644916] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.644997] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.645142] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.645233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.645301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.645451] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.645585] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.645670] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.645725] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.645859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.645931] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.646016] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2472.653928] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2472.661944] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2472.672824] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.672957] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.673022] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.673224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.673306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.673397] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 2472.707277] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.707437] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.707510] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.707728] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.707877] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.721021] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 2472.936038] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.936309] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.936485] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.936797] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.936984] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.937284] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-455 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.937491] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.937687] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.937958] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.938257] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.938458] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.938619] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.938876] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.939077] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.939273] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-455" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.939565] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.939766] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.939925] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.940194] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.940374] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.940791] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-5527610e-ccdb-4f39-a124-4c2649616129 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.940916] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-5527610e-ccdb-4f39-a124-4c2649616129" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.940996] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-5527610e-ccdb-4f39-a124-4c2649616129" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.941319] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-5527610e-ccdb-4f39-a124-4c2649616129" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.941525] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5527610e-ccdb-4f39-a124-4c2649616129',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2472.955545] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.955741] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.955916] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.956207] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.956411] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.956605] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 5527610e-ccdb-4f39-a124-4c2649616129 not found, creating... [ 2472.956897] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.957101] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.957263] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.957514] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.957695] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.958046] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.958253] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.958416] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.958673] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.958847] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.959029] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 5527610e-ccdb-4f39-a124-4c2649616129 is going to be created. [ 2472.979912] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2472.980193] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2472.980396] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2472.980706] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2472.981049] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2472.981435] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-5527610e-ccdb-4f39-a124-4c2649616129" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2473.199589] env[61817]: INFO networking_nsxv3.common.synchronization [req-910d9db5-5da8-411b-a2a4-3a11e3bbc51f req-14d40720-1843-438d-b4fa-7c7243d17d18 service neutron] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_rules [ 2473.199807] env[61817]: INFO networking_nsxv3.common.synchronization [req-910d9db5-5da8-411b-a2a4-3a11e3bbc51f req-14d40720-1843-438d-b4fa-7c7243d17d18 service neutron] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2473.199959] env[61817]: INFO networking_nsxv3.common.synchronization [req-910d9db5-5da8-411b-a2a4-3a11e3bbc51f req-14d40720-1843-438d-b4fa-7c7243d17d18 service neutron] Enqueued Resource ID: 5527610e-ccdb-4f39-a124-4c2649616129 with Priority: HIGHEST for action port [ 2473.200217] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_rules [ 2473.200347] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2473.200449] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5527610e-ccdb-4f39-a124-4c2649616129 with Priority: HIGHEST for action port [ 2473.201061] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2473.201191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2473.201257] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2473.201491] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2473.201580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2473.201742] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2473.201841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2473.201904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2473.202061] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2473.202142] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2473.203054] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2473.203164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2473.203232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2473.203393] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2473.203507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2473.203672] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2473.203749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2473.203976] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2473.204092] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2473.204154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2473.204303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2473.204382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2473.204518] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-5527610e-ccdb-4f39-a124-4c2649616129 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2473.204606] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5527610e-ccdb-4f39-a124-4c2649616129" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2473.204668] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5527610e-ccdb-4f39-a124-4c2649616129" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2473.204808] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5527610e-ccdb-4f39-a124-4c2649616129" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2473.204884] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5527610e-ccdb-4f39-a124-4c2649616129',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2473.234817] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2473.235019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2473.235019] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2473.235179] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2473.235264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2473.235516] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2473.235596] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2473.235764] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5527610e-ccdb-4f39-a124-4c2649616129 with status ACTIVE [ 2473.235916] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2473.236152] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2473.236152] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2473.236258] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2473.236318] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2473.236475] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2473.236559] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2473.236616] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2473.236784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2473.236856] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2473.662976] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2473.663421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2473.663421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2473.663516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2473.663569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2473.663667] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5527610e-ccdb-4f39-a124-4c2649616129 is going to be updated. [ 2473.685963] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2473.686209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2473.686209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2473.686378] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2473.686522] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2473.686681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5527610e-ccdb-4f39-a124-4c2649616129" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2474.116147] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 2474.116379] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2474.731191] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 2474.731645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2474.731645] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2474.731864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2474.732065] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2474.732190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2474.732255] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2474.732474] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2474.732571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2474.732692] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2474.741558] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2474.749590] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2474.758637] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2474.758783] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2474.758854] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2474.759157] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2474.759356] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2474.759476] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 2474.799151] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2474.799390] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2474.799390] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2474.800070] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2474.800070] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2474.809348] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 2476.819916] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 2476.820297] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.820297] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.820442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.820684] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2476.820797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2476.820797] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.820952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.821031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.821115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.821204] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2476.830686] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2476.830842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2476.830882] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.831031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.831101] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.831256] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2476.831364] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2476.831455] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.831573] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.831710] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2476.831818] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2476.831892] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.831986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.832073] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.832146] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.832290] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2476.832430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2476.832520] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.832640] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.832718] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.832843] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2476.832937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2476.833009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.833115] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.833246] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2476.833337] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2476.833418] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.833511] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.833580] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.833661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.833744] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2476.839743] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0: rpc.has_security_group_logging(os_id): False [ 2476.857348] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2476.857576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2476.857576] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.857835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.857930] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.858120] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2476.858220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2476.858277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.858422] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.858499] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.858698] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2476.858789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2476.858842] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.858980] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.859053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.859272] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2476.859379] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2476.859435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.859563] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.859639] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.859723] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 2476.920993] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2476.921311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2476.921311] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2476.921463] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2476.921604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2476.940263] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 2478.201712] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2478.202049] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 2478.957742] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 2478.957983] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2483.203533] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2483.203983] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2488.205552] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2488.205958] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2493.207368] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2493.207729] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2498.208770] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2498.209157] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2503.210298] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2503.210610] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2508.211240] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2508.211665] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2513.212365] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2513.212750] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2518.214275] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2518.214671] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2522.902935] env[61817]: INFO networking_nsxv3.common.synchronization [req-54744886-2bc9-4d76-b404-41b434ab369e req-8cdb6428-b283-417b-88d2-69a5ffe6ff43 tempest-ServersTestJSON-1722207346 tempest-ServersTestJSON-1722207346-project-member] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 2522.903464] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGHEST for action security_group_members [ 2522.903794] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2522.903974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2522.903974] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2522.904187] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2522.904273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2522.904538] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2522.904538] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2522.904724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2522.904724] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2522.904845] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2522.904924] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2522.905000] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2522.905099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2522.905291] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2522.905387] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2522.920901] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2522.920901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2522.920901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2522.920901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2522.920901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2522.921618] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2522.921618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2522.921618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2522.921618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2522.921618] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2522.921618] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be updated. [ 2522.955467] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2522.955610] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2522.955678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2522.956048] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2522.956196] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2522.969157] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: IN_PROGRESS for 2s [ 2524.979630] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd in Status: SUCCESS [ 2524.980116] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd deletion is rescheduled due to dependency. [ 2524.980116] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2527.904717] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2527.905087] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2532.905401] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2532.905875] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2537.906064] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2537.906433] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2542.907583] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2542.907959] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2547.909316] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2547.909316] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2552.910832] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2552.911172] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2557.911804] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2557.911804] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2562.913208] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2562.913520] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2567.915064] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2567.915064] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2572.656425] env[61817]: INFO networking_nsxv3.common.synchronization [req-c86db6a8-e4a6-45e3-b0b1-e144de7a0459 req-206793a1-a4b6-4d7f-8703-7a602204bd99 tempest-DeleteServersTestJSON-1745478556 tempest-DeleteServersTestJSON-1745478556-project-member] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2572.657123] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2572.657278] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2572.657363] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2572.657445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2572.657613] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2572.657701] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2572.657850] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2572.657943] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2572.657997] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2572.658160] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2572.658295] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2572.658388] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2572.658436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2572.658571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2572.658649] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2572.658730] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2572.671577] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2572.679593] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2572.687274] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2572.687412] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2572.687480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2572.687675] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2572.687791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2572.687884] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 2572.722665] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2572.722798] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2572.722874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2572.723151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2572.723328] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2572.740218] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 2574.750913] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 2574.751309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2577.658507] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2577.658912] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2582.659593] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2582.659958] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2587.660417] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2587.660816] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2592.661455] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2592.661455] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2597.662756] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2597.663034] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2602.664188] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2602.664589] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2607.665664] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2607.665938] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2612.667127] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2612.667491] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2617.668661] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2617.669047] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2622.670339] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2622.670339] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2627.671200] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2627.671621] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2632.672721] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2632.673116] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2637.673531] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2637.673942] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2642.674255] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2642.674632] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2647.675431] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2647.675813] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2652.676201] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2652.676557] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2657.677532] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2657.677954] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2662.678384] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2662.678838] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2667.679283] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2667.679639] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2672.680752] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2672.681160] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2672.869832] env[61817]: INFO networking_nsxv3.common.synchronization [req-70e06b92-7067-4c1c-af88-9dde4c61474a req-94b8defd-1e07-4ba8-8a7d-d02e6aed8a12 tempest-ImagesTestJSON-1042540315 tempest-ImagesTestJSON-1042540315-project-member] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2672.870339] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGHEST for action security_group_members [ 2672.871068] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2672.871180] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2672.871180] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2672.871449] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2672.871552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2672.871711] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2672.871816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2672.871883] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2672.872053] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2672.872298] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2672.872298] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2672.872414] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2672.872500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2672.872567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2672.872625] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2672.885193] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2672.885328] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2672.885396] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2672.885585] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2672.885676] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2672.885856] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2672.885952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2672.886011] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2672.886159] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2672.886238] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2672.886322] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be updated. [ 2672.924601] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2672.924601] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2672.924810] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2672.924860] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2672.924966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2672.933943] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: IN_PROGRESS for 2s [ 2674.947149] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b in Status: SUCCESS [ 2674.947464] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b deletion is rescheduled due to dependency. [ 2674.947464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2677.007411] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:8 completed [ 2677.007808] env[61817]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-4de46d71-64c3-4d5b-ad72-ff69811d96b9 None None] NSXv3 Agent Agent loop - iteration:9 started [ 2677.871981] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2677.872218] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2681.832836] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 97 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2681.833366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2681.833366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2681.833366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2681.833366] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2681.833642] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 100 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2681.833642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2681.833778] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2681.833837] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2681.833948] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2681.842226] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2681.848629] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2681.854216] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 2681.854339] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 2682.461778] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 118 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.462093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.462093] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.462237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.475513] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 2682.475965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.476938] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 2682.506835] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 120 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.507105] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.507105] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.507267] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.514951] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.515446] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:3. [ 2682.515531] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'06400e19-047a-44d4-986c-d11a038e8e24', 'c895672b-c5c9-4de8-af83-e7ec7b56ebaf', '97080397-f392-4ee1-a22e-dace086e482f'} {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2682.515617] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 2682.536593] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.536859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.536859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.537106] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.537388] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.537525] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2682.564196] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 970 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.564475] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.564475] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.564626] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.564727] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.564863] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2682.590085] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 121 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 971 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.590365] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.590365] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.590500] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.590603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.590745] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:3. [ 2682.590824] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'3ffcb57e-8678-415b-bd13-19b60dbd45bd', '5a2644aa-f99a-4b14-9145-702ba5c8452b', '8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0'} {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2682.590888] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 2682.607796] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 122 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.608063] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.608063] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.608210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.608273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.608380] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 2682.608449] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2682.608509] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 2682.636792] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 125 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 967 in outdated>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.637055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.637055] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.637190] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.637465] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.637607] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 2682.637684] env[61817]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=61817) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1004}} [ 2682.637749] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 2682.637812] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 3/3 resources of Type:Ports [ 2682.637892] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06400e19-047a-44d4-986c-d11a038e8e24 with Priority: HIGH for action port [ 2682.637970] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c895672b-c5c9-4de8-af83-e7ec7b56ebaf with Priority: HIGH for action port [ 2682.638030] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97080397-f392-4ee1-a22e-dace086e482f with Priority: HIGH for action port [ 2682.638092] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 3/3 resources of Type:Security Group Rules [ 2682.638148] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 2682.638205] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 2682.638262] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 2682.638320] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 2682.638373] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 2682.638537] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 170 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.638640] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.638698] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.638845] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.638920] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.639085] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.639175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.639231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.639398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.639488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.639654] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.639744] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.639799] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.639932] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.640013] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.640180] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.640309] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.640399] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.640577] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.640652] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.640815] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.640903] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.640958] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.641086] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.641149] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.641307] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.641409] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.641484] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.641607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.641682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.641840] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.641927] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.641982] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.642107] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.642171] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.642329] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.642408] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.642473] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.642593] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.642665] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.642819] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 172 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in age>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1013 in <listcomp>>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.642972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.642972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.643091] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.643145] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.643224] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 2682.643284] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 2682.643338] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 2682.669429] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1030 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.669635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.669635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.669778] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.669961] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.670091] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 2682.696860] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py, line 150 in _run_loop>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 164 in _sync_all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 164 in all>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 184 in _age_cycle>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 1031 in sanitize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 945 in metadata_refresh>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.697077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.697077] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.697232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.697368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.710414] env[61817]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 2682.710586] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.873318] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2682.873736] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=7], Jobs=0 [ 2682.873736] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06400e19-047a-44d4-986c-d11a038e8e24 with Priority: HIGH for action port [ 2682.873736] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97080397-f392-4ee1-a22e-dace086e482f with Priority: HIGH for action port [ 2682.873736] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGH for action security_group_rules [ 2682.873975] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be75a65-f7ae-441f-8e97-1ee94103b74a with Priority: HIGH for action remove_orphan_remote_prefixes [ 2682.873975] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b with Priority: HIGH for action security_group_rules [ 2682.873975] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c895672b-c5c9-4de8-af83-e7ec7b56ebaf with Priority: HIGH for action port [ 2682.874143] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd with Priority: HIGH for action security_group_rules [ 2682.874378] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.874528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.874603] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.874815] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.874899] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.875059] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-06400e19-047a-44d4-986c-d11a038e8e24 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.875154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06400e19-047a-44d4-986c-d11a038e8e24" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.875213] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06400e19-047a-44d4-986c-d11a038e8e24" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.875436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06400e19-047a-44d4-986c-d11a038e8e24" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.875526] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06400e19-047a-44d4-986c-d11a038e8e24',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2682.876526] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.876642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.876702] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.876859] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.876935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.877076] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-97080397-f392-4ee1-a22e-dace086e482f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.877231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97080397-f392-4ee1-a22e-dace086e482f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.877231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97080397-f392-4ee1-a22e-dace086e482f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.877391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97080397-f392-4ee1-a22e-dace086e482f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.877471] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97080397-f392-4ee1-a22e-dace086e482f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2682.878288] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.878398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.878464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.878607] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.878681] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.878811] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.878893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.879169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.879169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.879169] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2682.880675] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.880791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.880857] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.881006] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.881081] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.881217] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a2644aa-f99a-4b14-9145-702ba5c8452b taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.881306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.881362] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.881524] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.881586] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a2644aa-f99a-4b14-9145-702ba5c8452b',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2682.882612] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.882612] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.882790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.882845] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.882900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.883024] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-c895672b-c5c9-4de8-af83-e7ec7b56ebaf taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.883109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c895672b-c5c9-4de8-af83-e7ec7b56ebaf" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.883169] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c895672b-c5c9-4de8-af83-e7ec7b56ebaf" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.883336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c895672b-c5c9-4de8-af83-e7ec7b56ebaf" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.883417] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c895672b-c5c9-4de8-af83-e7ec7b56ebaf',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2682.884119] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.884228] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.884287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.884438] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.884515] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.884651] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.884742] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.884800] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.884940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.885011] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffcb57e-8678-415b-bd13-19b60dbd45bd',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2682.887168] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06400e19-047a-44d4-986c-d11a038e8e24 [ 2682.887340] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.887447] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.887507] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.887657] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.887740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.901707] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97080397-f392-4ee1-a22e-dace086e482f [ 2682.901915] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.902038] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.902098] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.902286] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.902405] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.906375] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c895672b-c5c9-4de8-af83-e7ec7b56ebaf [ 2682.906558] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.906673] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.906733] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.906904] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.906986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.915370] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.915546] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.915546] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.915721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.915805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.915955] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.916083] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.916272] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.916350] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.916435] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.916525] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.916584] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.916716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.916791] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.916872] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.916957] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2682.924272] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.924435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.924498] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.924625] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.924709] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.924858] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.924952] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.925009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.925151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.925290] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.925381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.925439] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.925570] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.925648] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.925729] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.925876] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.925966] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.926026] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.926155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.926227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.926395] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.926471] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.926527] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.926626] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.926758] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.926845] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.926900] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.927030] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.927099] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.927176] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.927262] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2682.933601] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0: rpc.has_security_group_logging(os_id): False [ 2682.942628] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.942805] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.942880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.943013] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.945843] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.945945] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.957492] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2682.957707] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2682.970153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.970321] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffcb57e-8678-415b-bd13-19b60dbd45bd is going to be deleted. [ 2682.971495] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.971700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2682.990155] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2682.990374] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a2644aa-f99a-4b14-9145-702ba5c8452b is going to be deleted. [ 2682.991164] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2682.991376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.021611] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.021887] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.022067] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.022067] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.022260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.022361] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.022581] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.022738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.022738] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.022910] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.022910] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.023083] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.023204] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.023296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.023382] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.023469] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.023567] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 2683.029606] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.029831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.029831] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.029992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.030066] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.030135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c895672b-c5c9-4de8-af83-e7ec7b56ebaf" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.030852] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.030984] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.031073] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.031148] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.031224] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.031347] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06400e19-047a-44d4-986c-d11a038e8e24" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.031972] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 766 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 686 in _delete_segment_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.032114] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.032209] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.032306] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.032394] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.032551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97080397-f392-4ee1-a22e-dace086e482f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.035798] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.035956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.036088] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.036183] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.036271] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.036367] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffcb57e-8678-415b-bd13-19b60dbd45bd" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.044658] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 257 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 886 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 633 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 963 in metadata_delete>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.044851] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.044851] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.045045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.045045] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.045199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a2644aa-f99a-4b14-9145-702ba5c8452b" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.206991] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2683.207307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2683.207307] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2683.207441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2683.207532] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2683.230446] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 2685.245839] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 2685.246237] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2687.874848] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2687.875272] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2692.876604] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2692.876992] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2697.877625] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2697.878059] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2702.878787] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2702.879141] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2707.880102] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2707.880587] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2712.881994] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2712.881994] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2717.882846] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2717.883219] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2722.637498] env[61817]: INFO networking_nsxv3.common.synchronization [req-910d9db5-5da8-411b-a2a4-3a11e3bbc51f req-33b2594b-dc21-4720-97ff-55ab8d81885f tempest-DeleteServersTestJSON-1745478556 tempest-DeleteServersTestJSON-1745478556-project-member] Enqueued Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2722.638030] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 with Priority: HIGHEST for action security_group_members [ 2722.638344] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2722.638463] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2722.638528] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2722.638716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2722.638826] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2722.638999] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2722.639096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2722.639154] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2722.639317] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2722.639499] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2722.639597] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2722.639655] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2722.639793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2722.639866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2722.639950] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2722.654762] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2722.654940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2722.654995] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2722.655147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2722.655231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2722.655419] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2722.655562] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2722.655629] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2722.655778] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2722.655855] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2722.655941] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 is going to be updated. [ 2722.690500] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2722.690648] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2722.690721] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2722.690937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2722.691084] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2722.701431] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: IN_PROGRESS for 2s [ 2724.712421] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 in Status: SUCCESS [ 2724.712784] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0 deletion is rescheduled due to dependency. [ 2724.712784] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bf5c7da-3d6d-4fa5-bf8d-a40dd96f3ad0" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2727.639822] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2727.640168] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2727.973814] env[61817]: INFO networking_nsxv3.common.synchronization [None req-b24bec95-589d-4465-a3c8-b40aba58249b None None] Enqueued Resource ID: 55630e6d-3345-486c-af5a-cade4386caab with Priority: HIGHEST for action port [ 2727.974078] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55630e6d-3345-486c-af5a-cade4386caab with Priority: HIGHEST for action port [ 2727.974659] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2727.974789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2727.974858] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2727.975049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2727.975135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2727.975281] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-55630e6d-3345-486c-af5a-cade4386caab taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2727.975368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55630e6d-3345-486c-af5a-cade4386caab" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2727.975435] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55630e6d-3345-486c-af5a-cade4386caab" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2727.975661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55630e6d-3345-486c-af5a-cade4386caab" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2727.975743] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55630e6d-3345-486c-af5a-cade4386caab',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2727.985004] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55630e6d-3345-486c-af5a-cade4386caab [ 2727.985195] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2727.985313] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2727.985386] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2727.985593] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2727.985688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2727.985783] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55630e6d-3345-486c-af5a-cade4386caab already deleted. [ 2727.985864] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55630e6d-3345-486c-af5a-cade4386caab" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.341233] env[61817]: INFO networking_nsxv3.common.synchronization [req-57094ec4-d981-4fde-8f9b-067a5fc3af99 req-c5b8e31e-d599-4204-b3d7-d58abab0ef46 tempest-ServerAddressesNegativeTestJSON-1197890054 tempest-ServerAddressesNegativeTestJSON-1197890054-project-member] Enqueued Resource ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e with Priority: HIGHEST for action security_group_members [ 2729.341947] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e with Priority: HIGHEST for action security_group_members [ 2729.342397] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.342551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.342551] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.342717] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.342905] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.342905] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.343050] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.343050] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.343218] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.343449] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.343558] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.343626] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.343760] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.343876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.344009] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eecc1190-0d1b-4204-b1bb-8afb9cc17e3e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2729.368981] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.369172] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.369227] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.369453] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.369549] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.369738] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.369846] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.369921] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.370135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.370135] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.370242] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e already deleted. [ 2729.370348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.638875] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.639088] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.639217] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.639578] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.639745] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.640018] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-798 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.640182] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-798" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.640303] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-798" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.640597] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-798" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.640838] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.640994] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.641167] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.641319] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.641502] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.641661] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-798" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.641905] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.642067] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.642174] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.642377] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.642539] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.642778] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-44101a8d-2a25-45b1-813c-7071a7b7ef7f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.642933] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-44101a8d-2a25-45b1-813c-7071a7b7ef7f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.643076] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-44101a8d-2a25-45b1-813c-7071a7b7ef7f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.643289] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-44101a8d-2a25-45b1-813c-7071a7b7ef7f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.643427] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44101a8d-2a25-45b1-813c-7071a7b7ef7f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2729.723095] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.723332] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.723456] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.723757] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.723917] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.724099] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 44101a8d-2a25-45b1-813c-7071a7b7ef7f not found, creating... [ 2729.724366] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.724526] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.724647] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.724875] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.725017] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.725297] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.725454] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.725568] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.725786] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.725968] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.726027] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 44101a8d-2a25-45b1-813c-7071a7b7ef7f is going to be created. [ 2729.749413] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.749701] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.749800] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.750067] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.750318] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.750544] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-44101a8d-2a25-45b1-813c-7071a7b7ef7f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.981258] env[61817]: INFO networking_nsxv3.common.synchronization [None req-df92b4b5-e0d4-499c-bd2e-dc07b2091c81 None None] Enqueued Resource ID: 15cd34b9-619c-4ef1-ac54-24a5d120ffa3 with Priority: HIGHEST for action port [ 2729.981531] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15cd34b9-619c-4ef1-ac54-24a5d120ffa3 with Priority: HIGHEST for action port [ 2729.982091] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.982222] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.982288] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.982518] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.982621] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2729.982778] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-15cd34b9-619c-4ef1-ac54-24a5d120ffa3 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2729.982882] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15cd34b9-619c-4ef1-ac54-24a5d120ffa3" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2729.982947] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15cd34b9-619c-4ef1-ac54-24a5d120ffa3" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2729.983130] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15cd34b9-619c-4ef1-ac54-24a5d120ffa3" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2729.983212] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15cd34b9-619c-4ef1-ac54-24a5d120ffa3',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2730.003931] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15cd34b9-619c-4ef1-ac54-24a5d120ffa3 [ 2730.004169] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.004300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.004368] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.004661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.004661] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.004775] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15cd34b9-619c-4ef1-ac54-24a5d120ffa3 already deleted. [ 2730.004841] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15cd34b9-619c-4ef1-ac54-24a5d120ffa3" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.160319] env[61817]: INFO networking_nsxv3.common.synchronization [req-57094ec4-d981-4fde-8f9b-067a5fc3af99 req-89ee2573-1198-49d9-9db3-cae52245b894 service neutron] Enqueued Resource ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e with Priority: HIGHEST for action security_group_rules [ 2730.160501] env[61817]: INFO networking_nsxv3.common.synchronization [req-57094ec4-d981-4fde-8f9b-067a5fc3af99 req-89ee2573-1198-49d9-9db3-cae52245b894 service neutron] Enqueued Resource ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e with Priority: HIGHEST for action security_group_members [ 2730.160646] env[61817]: INFO networking_nsxv3.common.synchronization [req-57094ec4-d981-4fde-8f9b-067a5fc3af99 req-89ee2573-1198-49d9-9db3-cae52245b894 service neutron] Enqueued Resource ID: 44101a8d-2a25-45b1-813c-7071a7b7ef7f with Priority: HIGHEST for action port [ 2730.161133] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e with Priority: HIGHEST for action security_group_rules [ 2730.161270] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e with Priority: HIGHEST for action security_group_members [ 2730.161370] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44101a8d-2a25-45b1-813c-7071a7b7ef7f with Priority: HIGHEST for action port [ 2730.162037] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.162037] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.162205] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.162264] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.162321] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.162513] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.162615] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.162682] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.162876] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.163015] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eecc1190-0d1b-4204-b1bb-8afb9cc17e3e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2730.163987] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.164111] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.164176] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.164324] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.164407] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.164550] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.164642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.164703] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.164834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.164970] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.165074] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.165137] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.165242] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.165318] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.165402] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eecc1190-0d1b-4204-b1bb-8afb9cc17e3e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2730.166134] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.166296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.166296] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.166443] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.166521] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.166658] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-44101a8d-2a25-45b1-813c-7071a7b7ef7f taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.166754] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44101a8d-2a25-45b1-813c-7071a7b7ef7f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.166814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44101a8d-2a25-45b1-813c-7071a7b7ef7f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.166932] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44101a8d-2a25-45b1-813c-7071a7b7ef7f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.166999] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44101a8d-2a25-45b1-813c-7071a7b7ef7f',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2730.190866] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eecc1190-0d1b-4204-b1bb-8afb9cc17e3e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2730.210047] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.210233] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.210303] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.210445] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.210530] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.210704] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.210890] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.221781] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eecc1190-0d1b-4204-b1bb-8afb9cc17e3e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2730.237948] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44101a8d-2a25-45b1-813c-7071a7b7ef7f with status ACTIVE [ 2730.238287] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.238287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.238287] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.238622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.238622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.238847] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.238847] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.238991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.239049] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.239112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.255171] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.255171] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.255171] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.255643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.255643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.255643] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e is going to be created. [ 2730.290904] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.291273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.291273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.291475] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.291569] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.305951] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e in Status: UNINITIALIZED for 2s [ 2730.580637] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.581076] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.581076] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.581076] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.581191] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.581262] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44101a8d-2a25-45b1-813c-7071a7b7ef7f is going to be updated. [ 2730.600888] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2730.601109] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2730.601168] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2730.601392] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2730.601622] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2730.601834] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44101a8d-2a25-45b1-813c-7071a7b7ef7f" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.325820] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e in Status: SUCCESS [ 2732.326300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.326300] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.326459] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.326633] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.326770] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2732.326866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.327024] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.327087] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.327147] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.327324] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eecc1190-0d1b-4204-b1bb-8afb9cc17e3e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2732.339438] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.339623] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2732.339690] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.339878] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.339963] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.340151] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.340269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2732.340310] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.340471] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.340623] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.340713] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2732.340776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.340910] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.340987] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.341068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.341218] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.341316] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2732.341357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.341572] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.341642] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.341782] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.341871] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2732.341935] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.342059] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.342186] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.342282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2732.342323] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.342471] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.342560] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.342643] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.342727] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eecc1190-0d1b-4204-b1bb-8afb9cc17e3e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2732.349184] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eecc1190-0d1b-4204-b1bb-8afb9cc17e3e: rpc.has_security_group_logging(os_id): False [ 2732.368085] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.368278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2732.368278] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.368491] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.368579] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.368795] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.368888] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2732.368988] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.369097] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.369174] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.369361] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.369488] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2732.369534] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.369667] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.369744] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.369917] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.370039] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2732.370090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.370199] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.370273] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.370355] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e is going to be created. [ 2732.433564] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2732.433816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2732.433816] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2732.434032] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2732.434153] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2732.456254] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e in Status: IN_PROGRESS for 2s [ 2734.471166] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e in Status: SUCCESS [ 2734.471664] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2735.162028] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2735.162274] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2740.163623] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2740.164036] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2745.164785] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2745.165162] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2750.166361] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2750.166740] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2755.167425] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2755.167816] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2760.168457] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2760.168938] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2765.169961] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2765.170353] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2770.170676] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2770.171120] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2775.171805] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2775.172263] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2780.172917] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2780.173314] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2782.742125] env[61817]: INFO networking_nsxv3.common.synchronization [req-57094ec4-d981-4fde-8f9b-067a5fc3af99 req-71cd564a-c3ec-49f6-a0b4-66a65cc87577 tempest-ServerAddressesNegativeTestJSON-1197890054 tempest-ServerAddressesNegativeTestJSON-1197890054-project-member] Enqueued Resource ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e with Priority: HIGHEST for action security_group_members [ 2782.742782] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e with Priority: HIGHEST for action security_group_members [ 2782.743077] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2782.743170] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2782.743221] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2782.743391] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2782.743464] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2782.743693] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2782.743693] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2782.743829] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2782.743925] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2782.744077] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2782.744166] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2782.744225] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2782.744358] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2782.744516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2782.744516] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eecc1190-0d1b-4204-b1bb-8afb9cc17e3e',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2782.757874] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2782.757874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2782.757874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2782.757874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2782.757874] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2782.758138] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2782.758138] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2782.758231] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2782.758302] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2782.758376] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2782.758459] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e is going to be updated. [ 2782.790591] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2782.790789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2782.790875] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2782.791095] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2782.791440] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2782.806575] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e in Status: IN_PROGRESS for 2s [ 2784.818199] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e in Status: SUCCESS [ 2784.818454] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eecc1190-0d1b-4204-b1bb-8afb9cc17e3e deletion is rescheduled due to dependency. [ 2784.818493] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eecc1190-0d1b-4204-b1bb-8afb9cc17e3e" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2787.022688] env[61817]: INFO networking_nsxv3.common.synchronization [None req-15df6f51-68d6-4b79-ab71-120deb681810 None None] Enqueued Resource ID: 934eda0f-2de9-4e82-b45d-cf2551b47a61 with Priority: HIGHEST for action port [ 2787.022990] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934eda0f-2de9-4e82-b45d-cf2551b47a61 with Priority: HIGHEST for action port [ 2787.023555] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2787.023686] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2787.023759] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2787.023969] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2787.024082] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2787.024236] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-934eda0f-2de9-4e82-b45d-cf2551b47a61 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2787.024339] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-934eda0f-2de9-4e82-b45d-cf2551b47a61" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2787.024389] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-934eda0f-2de9-4e82-b45d-cf2551b47a61" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2787.024590] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-934eda0f-2de9-4e82-b45d-cf2551b47a61" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2787.024674] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('934eda0f-2de9-4e82-b45d-cf2551b47a61',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2787.066139] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 934eda0f-2de9-4e82-b45d-cf2551b47a61 [ 2787.066362] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2787.066604] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2787.066706] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2787.066924] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2787.067017] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2787.067100] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:934eda0f-2de9-4e82-b45d-cf2551b47a61 already deleted. [ 2787.067176] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-934eda0f-2de9-4e82-b45d-cf2551b47a61" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2789.083044] env[61817]: INFO networking_nsxv3.common.synchronization [None req-6ed57e1d-29cc-4d52-ab05-76032b43db5e None None] Enqueued Resource ID: cc110d3e-11a4-40b3-bdbc-c703fce250cb with Priority: HIGHEST for action port [ 2789.083044] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc110d3e-11a4-40b3-bdbc-c703fce250cb with Priority: HIGHEST for action port [ 2789.083044] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2789.083044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2789.083044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2789.083044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2789.083044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2789.083044] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc110d3e-11a4-40b3-bdbc-c703fce250cb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2789.083044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc110d3e-11a4-40b3-bdbc-c703fce250cb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2789.083044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc110d3e-11a4-40b3-bdbc-c703fce250cb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2789.083044] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc110d3e-11a4-40b3-bdbc-c703fce250cb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2789.083044] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc110d3e-11a4-40b3-bdbc-c703fce250cb',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2789.102036] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc110d3e-11a4-40b3-bdbc-c703fce250cb [ 2789.102484] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2789.102879] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2789.103126] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2789.103444] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2789.103776] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2789.103990] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc110d3e-11a4-40b3-bdbc-c703fce250cb already deleted. [ 2789.104247] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc110d3e-11a4-40b3-bdbc-c703fce250cb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2789.464357] env[61817]: INFO networking_nsxv3.common.synchronization [None req-936af884-affb-4d3f-a1c1-4d4af0e90241 None None] Enqueued Resource ID: 0eae5887-0e09-4176-89f8-c2e69c6da333 with Priority: HIGHEST for action port [ 2789.464357] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eae5887-0e09-4176-89f8-c2e69c6da333 with Priority: HIGHEST for action port [ 2789.464357] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2789.464357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2789.464357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2789.464357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2789.464357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2789.464357] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eae5887-0e09-4176-89f8-c2e69c6da333 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2789.464357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eae5887-0e09-4176-89f8-c2e69c6da333" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2789.464357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eae5887-0e09-4176-89f8-c2e69c6da333" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2789.464357] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eae5887-0e09-4176-89f8-c2e69c6da333" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2789.464357] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eae5887-0e09-4176-89f8-c2e69c6da333',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2789.480182] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0eae5887-0e09-4176-89f8-c2e69c6da333 [ 2789.480384] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2789.480508] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2789.480578] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2789.480772] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2789.480855] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2789.480945] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0eae5887-0e09-4176-89f8-c2e69c6da333 already deleted. [ 2789.481021] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eae5887-0e09-4176-89f8-c2e69c6da333" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.111056] env[61817]: INFO networking_nsxv3.common.synchronization [req-33127176-2d89-4c82-92b5-5495a348db5c req-fd13df8d-c1bb-4fba-9123-734a28e95843 tempest-ServersNegativeTestMultiTenantJSON-246455800 tempest-ServersNegativeTestMultiTenantJSON-246455800-project-member] Enqueued Resource ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 with Priority: HIGHEST for action security_group_members [ 2791.111640] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 with Priority: HIGHEST for action security_group_members [ 2791.112136] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.112239] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.112326] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.112575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.112666] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.112859] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.112965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.113029] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.113210] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.113360] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.113480] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.113801] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.113972] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.114057] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.114148] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('802a85e8-1cf9-4d4d-90c4-5bba7df231b4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2791.125151] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.125151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.125151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.125151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.125151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.125151] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.125151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.125151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.125151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.125151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.125151] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 already deleted. [ 2791.125151] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.566074] env[61817]: INFO networking_nsxv3.common.synchronization [None req-5712b05b-106b-497c-86d4-1f5de40dcdee None None] Enqueued Resource ID: d91fcac2-671a-4130-832a-e10f79e08cf7 with Priority: HIGHEST for action port [ 2791.566562] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d91fcac2-671a-4130-832a-e10f79e08cf7 with Priority: HIGHEST for action port [ 2791.566868] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.566991] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.567058] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.567253] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.567340] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.567499] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-d91fcac2-671a-4130-832a-e10f79e08cf7 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.567595] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d91fcac2-671a-4130-832a-e10f79e08cf7" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.567656] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d91fcac2-671a-4130-832a-e10f79e08cf7" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.567852] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d91fcac2-671a-4130-832a-e10f79e08cf7" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.567932] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d91fcac2-671a-4130-832a-e10f79e08cf7',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2791.577219] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d91fcac2-671a-4130-832a-e10f79e08cf7 [ 2791.577396] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 326 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.577505] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.577574] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.577744] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.577830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.577918] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d91fcac2-671a-4130-832a-e10f79e08cf7 already deleted. [ 2791.577994] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d91fcac2-671a-4130-832a-e10f79e08cf7" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.585642] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 355 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.585827] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.585951] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.586182] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.586323] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.586568] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock network-457 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 358 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.586724] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "network-457" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.586841] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "network-457" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.587102] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "network-457" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.587344] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 64 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 361 in network>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 867 in network_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.587499] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.587618] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.588115] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.588279] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.588436] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "network-457" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.588752] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 266 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.588956] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.589109] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.589327] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.589482] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.589731] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock port-5d3e834b-13bf-473b-bb7e-d3c0b800f1fb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 269 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.589889] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "port-5d3e834b-13bf-473b-bb7e-d3c0b800f1fb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.590010] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "port-5d3e834b-13bf-473b-bb7e-d3c0b800f1fb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.590260] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "port-5d3e834b-13bf-473b-bb7e-d3c0b800f1fb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.590399] env[61817]: DEBUG networking_nsxv3.api.rpc [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d3e834b-13bf-473b-bb7e-d3c0b800f1fb',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2791.604275] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.604480] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.604620] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.604875] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.605029] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.605180] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Segment Port 5d3e834b-13bf-473b-bb7e-d3c0b800f1fb not found, creating... [ 2791.605430] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.605588] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.605719] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.605939] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.606080] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.606360] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.606515] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.606635] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.606845] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.606981] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.607121] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Resource: SegmentPort with ID: 5d3e834b-13bf-473b-bb7e-d3c0b800f1fb is going to be created. [ 2791.628875] env[61817]: DEBUG networking_nsxv3.common.locking [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenpool.py, line 87 in _spawn_n_impl>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_green.py, line 69 in __call__>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/futurist/_utils.py, line 45 in run>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py, line 165 in _process_incoming>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 309 in dispatch>, <FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py, line 229 in _do_dispatch>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/agent.py, line 79 in get_network_bridge>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 278 in precreate_port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.629102] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.629234] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.630007] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.630255] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.630625] env[61817]: DEBUG oslo_concurrency.lockutils [None req-b4c61509-d361-46ac-94b0-ec5fcc2f1246 None None] Releasing lock "port-5d3e834b-13bf-473b-bb7e-d3c0b800f1fb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.870456] env[61817]: INFO networking_nsxv3.common.synchronization [req-33127176-2d89-4c82-92b5-5495a348db5c req-1cb427b4-2b9d-47e5-8f22-298581dc3194 service neutron] Enqueued Resource ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 with Priority: HIGHEST for action security_group_rules [ 2791.870647] env[61817]: INFO networking_nsxv3.common.synchronization [req-33127176-2d89-4c82-92b5-5495a348db5c req-1cb427b4-2b9d-47e5-8f22-298581dc3194 service neutron] Enqueued Resource ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 with Priority: HIGHEST for action security_group_members [ 2791.870789] env[61817]: INFO networking_nsxv3.common.synchronization [req-33127176-2d89-4c82-92b5-5495a348db5c req-1cb427b4-2b9d-47e5-8f22-298581dc3194 service neutron] Enqueued Resource ID: 5d3e834b-13bf-473b-bb7e-d3c0b800f1fb with Priority: HIGHEST for action port [ 2791.871012] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 with Priority: HIGHEST for action security_group_rules [ 2791.871137] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 with Priority: HIGHEST for action security_group_members [ 2791.871233] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d3e834b-13bf-473b-bb7e-d3c0b800f1fb with Priority: HIGHEST for action port [ 2791.871862] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 230 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.871993] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.872073] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.872348] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.872571] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.872775] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock rules-802a85e8-1cf9-4d4d-90c4-5bba7df231b4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 233 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.872887] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.872956] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.873189] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.873276] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('802a85e8-1cf9-4d4d-90c4-5bba7df231b4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2791.874538] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.874765] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.874844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.875009] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.875090] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.875241] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.875338] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.875398] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.875541] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.875680] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.875771] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.875830] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.875965] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.876054] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.876142] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('802a85e8-1cf9-4d4d-90c4-5bba7df231b4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2791.877763] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 307 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.877866] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.878254] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.878436] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.878635] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.878849] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d3e834b-13bf-473b-bb7e-d3c0b800f1fb taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 310 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.878919] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d3e834b-13bf-473b-bb7e-d3c0b800f1fb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.878977] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d3e834b-13bf-473b-bb7e-d3c0b800f1fb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.879085] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d3e834b-13bf-473b-bb7e-d3c0b800f1fb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.879158] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d3e834b-13bf-473b-bb7e-d3c0b800f1fb',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2791.888552] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('802a85e8-1cf9-4d4d-90c4-5bba7df231b4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2791.900874] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.901301] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.901377] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.901678] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.901950] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.902268] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.902508] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.904090] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('802a85e8-1cf9-4d4d-90c4-5bba7df231b4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2791.906820] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d3e834b-13bf-473b-bb7e-d3c0b800f1fb with status ACTIVE [ 2791.906947] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 760 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.907068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.907142] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.907336] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.907425] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.907604] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 794 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.907700] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.907735] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.907894] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.908025] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.912444] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.912627] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.912627] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.912823] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.912897] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2791.912983] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 is going to be created. [ 2791.982185] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 220 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 909 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2791.982425] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2791.982477] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2791.982766] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2791.982999] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2792.009880] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 in Status: UNINITIALIZED for 2s [ 2792.339715] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2792.340175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2792.340175] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2792.340269] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2792.340312] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2792.340418] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d3e834b-13bf-473b-bb7e-d3c0b800f1fb is going to be updated. [ 2792.361201] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 323 in port>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 437 in _port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 832 in port_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2792.361421] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2792.361516] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2792.361740] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2792.361898] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2792.362112] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d3e834b-13bf-473b-bb7e-d3c0b800f1fb" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.019848] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 in Status: SUCCESS [ 2794.020228] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.020228] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.020441] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.020619] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 238 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2794.020726] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2794.020790] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.020940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.021014] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.021096] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.021179] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('802a85e8-1cf9-4d4d-90c4-5bba7df231b4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2794.030081] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2794.030220] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2794.030266] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.030430] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.030511] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.030669] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2794.030769] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2794.030835] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.030984] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.031379] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2794.031379] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2794.031379] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.031575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.031575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.031575] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.031724] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2794.031819] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2794.031880] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.032031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.032108] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.032251] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2794.032341] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2794.032402] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.032550] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.032696] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 245 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2794.032789] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2794.032849] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.032986] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.033260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.033260] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.033260] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('802a85e8-1cf9-4d4d-90c4-5bba7df231b4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2794.039059] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 802a85e8-1cf9-4d4d-90c4-5bba7df231b4: rpc.has_security_group_logging(os_id): False [ 2794.056297] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 547 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2794.056439] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2794.056534] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.056793] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.056940] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.057137] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2794.057282] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2794.057339] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.057472] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.057552] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.057751] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 889 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 551 in _create_provider_sg>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 244 in _get_sg_provider_rule>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2794.057844] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2794.057901] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.058043] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.058118] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.058292] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2794.058380] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2794.058442] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.058624] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.058716] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.058802] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 is going to be created. [ 2794.117076] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 254 in security_group_rules>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 890 in sg_rules_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 662 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2794.117324] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2794.117324] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2794.117619] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2794.117814] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2794.128161] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 in Status: IN_PROGRESS for 2s [ 2796.140347] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 in Status: SUCCESS [ 2796.140632] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2796.872634] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2796.872905] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2801.873553] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2801.873553] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2806.874598] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2806.875010] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2811.875298] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2811.875713] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2816.876697] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2816.877068] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2821.878130] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2821.878515] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2826.879342] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2826.879834] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2831.880548] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2831.880942] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2836.881296] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2836.881747] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2841.882426] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2841.882895] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2842.896199] env[61817]: INFO networking_nsxv3.common.synchronization [req-33127176-2d89-4c82-92b5-5495a348db5c req-369ea5b6-fb01-4cf7-a208-cbf282d3943f tempest-ServersNegativeTestMultiTenantJSON-246455800 tempest-ServersNegativeTestMultiTenantJSON-246455800-project-member] Enqueued Resource ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 with Priority: HIGHEST for action security_group_members [ 2842.896757] env[61817]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 with Priority: HIGHEST for action security_group_members [ 2842.897147] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock migration-tracking taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 203 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider.py, line 442 in is_migration_in_progress>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2842.897297] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2842.897450] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2842.897679] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2842.897732] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "migration-tracking" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2842.897877] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4 taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 206 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2842.897976] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2842.898060] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2842.898232] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2842.898501] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 208 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2842.898567] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2842.898614] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2842.898750] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2842.898893] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2842.898936] env[61817]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('802a85e8-1cf9-4d4d-90c4-5bba7df231b4',) {} {{(pid=61817) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 2842.908843] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 902 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 914 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2842.908992] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2842.909068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2842.909277] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2842.909381] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2842.909583] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 627 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 921 in metadata>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2842.909688] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2842.909749] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2842.909937] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2842.910031] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2842.910131] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 is going to be updated. [ 2842.941906] env[61817]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [<FrameSummary file /opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py, line 264 in main>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py, line 222 in security_group_members>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 904 in sg_members_realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 35 in wrapper>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 649 in _realize>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py, line 927 in metadata_update>, <FrameSummary file /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py, line 47 in get_lock>] {{(pid=61817) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 2842.942068] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} [ 2842.942152] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} [ 2842.942548] env[61817]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:323}} [ 2842.942775] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2842.958353] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 in Status: IN_PROGRESS for 2s [ 2844.968735] env[61817]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 in Status: SUCCESS [ 2844.969102] env[61817]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 802a85e8-1cf9-4d4d-90c4-5bba7df231b4 deletion is rescheduled due to dependency. [ 2844.969102] env[61817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-802a85e8-1cf9-4d4d-90c4-5bba7df231b4" {{(pid=61817) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} [ 2847.898027] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2847.898340] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2852.899538] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2852.899915] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2857.901115] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2857.901525] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2862.902910] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2862.903311] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2867.904052] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2867.904424] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 2872.905167] env[61817]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 2872.905523] env[61817]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0